2024-02-22T18:26:22.692 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-22T18:26:22.692 DEBUG:teuthology.run:Teuthology command: teuthology --description rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} --verbose --owner scheduled_yuriw@teuthology --name yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570945 -- /home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570945/orig.config.yaml 2024-02-22T18:26:22.723 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T18:26:22.797 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570945 branch: pacific-release description: rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} email: null first_in_suite: false job_id: '7570945' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: pacific-release ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MON_DOWN\) - \(PG_ - mons down - pg inactive - out of quorum - \(OSD_ - osds down - osd down sha1: eb66ed921e744301e6863be6353618d63967ea59 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: eb66ed921e744301e6863be6353618d63967ea59 workunit: branch: wip-ksirivad-pacific-release-whitelist sha1: 391ea41edcaa85aa674d6e816fb2469974fc7d8e owner: scheduled_yuriw@teuthology priority: 61 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b seed: 264 sha1: eb66ed921e744301e6863be6353618d63967ea59 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-ksirivad-pacific-release-whitelist suite_path: /home/teuthworker/src/github.com_kamoltat_ceph_391ea41edcaa85aa674d6e816fb2469974fc7d8e/qa suite_relpath: qa suite_repo: https://github.com/kamoltat/ceph.git suite_sha1: 391ea41edcaa85aa674d6e816fb2469974fc7d8e targets: smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCoOCOxDlBOpsoSnCF8ASrPagfD8NY+HTjPizceoX+hd7er91STGzQcK7JxsXoVJax4pMgXRsRy4d1VeH7grdYE= smithi063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+eFwCrLJzFpx0tgYtF+cjHtaiNPa9ApyQKEPSnQf2sc675rM+kPsG68TZrB7luewfHGMoprUztRRbZ0EJheiI= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - cephadm: add_mons_via_daemon_add: true allow_ptrace: false avoid_pacific_features: true cephadm_branch: v15.2.0 cephadm_git_url: https://github.com/ceph/ceph image: docker.io/ceph/ceph:v15.2.0 - cephadm.shell: env: - sha1 mon.a: - radosgw-admin realm create --rgw-realm=r --default - radosgw-admin zonegroup create --rgw-zonegroup=default --master --default - radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default - radosgw-admin period update --rgw-realm=r --commit - ceph orch apply rgw r z --placement=2 --port=8000 - sleep 120 - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 mon.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 - ceph orch ls | grep '^osd ' - cephadm.shell: mon.a: - ceph orch upgrade ls - ceph orch upgrade ls --image quay.io/ceph/ceph | grep 16.2.0 - ceph orch upgrade ls --image quay.io/ceph/ceph --tags | grep v16.2.2 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-22_18:15:46 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-22T18:26:22.797 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_kamoltat_ceph_391ea41edcaa85aa674d6e816fb2469974fc7d8e/qa; will attempt to use it 2024-02-22T18:26:22.798 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_kamoltat_ceph_391ea41edcaa85aa674d6e816fb2469974fc7d8e/qa/tasks 2024-02-22T18:26:22.798 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-22T18:26:22.799 INFO:teuthology.task.internal:Checking packages... 2024-02-22T18:26:22.823 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'eb66ed921e744301e6863be6353618d63967ea59' 2024-02-22T18:26:22.823 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-22T18:26:22.823 INFO:teuthology.packaging:ref: None 2024-02-22T18:26:22.823 INFO:teuthology.packaging:tag: None 2024-02-22T18:26:22.823 INFO:teuthology.packaging:branch: pacific-release 2024-02-22T18:26:22.823 INFO:teuthology.packaging:sha1: eb66ed921e744301e6863be6353618d63967ea59 2024-02-22T18:26:22.823 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific-release 2024-02-22T18:26:22.975 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-550.geb66ed92 2024-02-22T18:26:22.976 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-22T18:26:22.982 INFO:teuthology.task.internal:no buildpackages task found 2024-02-22T18:26:22.983 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-22T18:26:22.988 INFO:teuthology.task.internal:Saving configuration 2024-02-22T18:26:22.999 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-22T18:26:23.006 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-22T18:26:23.031 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570945', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-22 18:18:36.622321', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCoOCOxDlBOpsoSnCF8ASrPagfD8NY+HTjPizceoX+hd7er91STGzQcK7JxsXoVJax4pMgXRsRy4d1VeH7grdYE='} 2024-02-22T18:26:23.056 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570945', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-22 18:18:36.620572', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+eFwCrLJzFpx0tgYtF+cjHtaiNPa9ApyQKEPSnQf2sc675rM+kPsG68TZrB7luewfHGMoprUztRRbZ0EJheiI='} 2024-02-22T18:26:23.056 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-22T18:26:23.062 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2024-02-22T18:26:23.062 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2024-02-22T18:26:23.062 INFO:teuthology.run_tasks:Running task console_log... 2024-02-22T18:26:23.132 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7feeadd860d0>, signals=[15]) 2024-02-22T18:26:23.132 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-22T18:26:23.138 INFO:teuthology.task.internal:Opening connections... 2024-02-22T18:26:23.138 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2024-02-22T18:26:23.140 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T18:26:23.211 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi063.front.sepia.ceph.com 2024-02-22T18:26:23.212 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T18:26:23.284 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-22T18:26:23.291 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-02-22T18:26:23.314 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-02-22T18:26:23.315 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-02-22T18:26:23.376 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2024-02-22T18:26:23.376 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="8" 2024-02-22T18:26:23.376 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2024-02-22T18:26:23.376 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2024-02-22T18:26:23.376 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="8" 2024-02-22T18:26:23.376 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el8" 2024-02-22T18:26:23.376 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-22T18:26:23.377 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2024-02-22T18:26:23.377 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-22T18:26:23.377 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2024-02-22T18:26:23.377 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-22T18:26:23.377 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-22T18:26:23.377 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-22T18:26:23.377 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-02-22T18:26:23.402 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2024-02-22T18:26:23.425 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2024-02-22T18:26:23.425 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2024-02-22T18:26:23.486 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream" 2024-02-22T18:26:23.487 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="8" 2024-02-22T18:26:23.487 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos" 2024-02-22T18:26:23.487 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora" 2024-02-22T18:26:23.487 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="8" 2024-02-22T18:26:23.487 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el8" 2024-02-22T18:26:23.487 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-22T18:26:23.487 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2024-02-22T18:26:23.487 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-22T18:26:23.487 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/" 2024-02-22T18:26:23.487 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-22T18:26:23.487 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-22T18:26:23.487 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-22T18:26:23.487 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2024-02-22T18:26:23.511 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-22T18:26:23.519 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-22T18:26:23.525 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-22T18:26:23.525 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2024-02-22T18:26:23.527 DEBUG:teuthology.orchestra.run.smithi063:> test '!' -e /home/ubuntu/cephtest 2024-02-22T18:26:23.548 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-22T18:26:23.554 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-22T18:26:23.554 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2024-02-22T18:26:23.589 DEBUG:teuthology.orchestra.run.smithi063:> test -z $(ls -A /var/lib/ceph) 2024-02-22T18:26:23.621 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-22T18:26:23.674 INFO:teuthology.run_tasks:Running task kernel... 2024-02-22T18:26:23.688 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-22T18:26:23.688 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-22T18:26:23.688 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-22T18:26:23.689 DEBUG:teuthology.orchestra.run.smithi063:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-22T18:26:23.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-22T18:26:23.709 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-02-22T18:26:23.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-22T18:26:23.710 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-02-22T18:26:23.770 INFO:teuthology.orchestra.run.smithi063.stdout:4.18.0-489.el8.x86_64 2024-02-22T18:26:23.770 INFO:teuthology.task.kernel:Running kernel on smithi063: 4.18.0-489.el8.x86_64 2024-02-22T18:26:23.770 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum install -y kernel 2024-02-22T18:26:23.772 INFO:teuthology.orchestra.run.smithi062.stdout:4.18.0-489.el8.x86_64 2024-02-22T18:26:23.772 INFO:teuthology.task.kernel:Running kernel on smithi062: 4.18.0-489.el8.x86_64 2024-02-22T18:26:23.772 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum install -y kernel 2024-02-22T18:26:28.837 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - AppStream 11 MB/s | 27 MB 00:02 2024-02-22T18:26:32.787 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 8 - AppStream 4.3 MB/s | 27 MB 00:06 2024-02-22T18:34:54.624 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - BaseOS 21 kB/s | 10 MB 08:20 2024-02-22T18:34:56.607 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - Extras 62 kB/s | 18 kB 00:00 2024-02-22T18:34:56.908 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 8 - Extras common packages 38 kB/s | 6.9 kB 00:00 2024-02-22T18:34:57.159 INFO:teuthology.orchestra.run.smithi063.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-02-22T18:34:58.437 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2024-02-22T18:34:59.086 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 8 - BaseOS 21 kB/s | 10 MB 08:21 2024-02-22T18:35:01.003 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 8 - Extras 87 kB/s | 18 kB 00:00 2024-02-22T18:35:01.437 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 8 - Extras common packages 22 kB/s | 6.9 kB 00:00 2024-02-22T18:35:01.697 INFO:teuthology.orchestra.run.smithi062.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2024-02-22T18:35:02.377 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 387 kB/s | 24 kB 00:00 2024-02-22T18:35:02.508 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2024-02-22T18:35:05.549 INFO:teuthology.orchestra.run.smithi063.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-22T18:35:05.549 INFO:teuthology.orchestra.run.smithi063.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-22T18:35:05.662 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-02-22T18:35:05.663 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-02-22T18:35:05.663 INFO:teuthology.orchestra.run.smithi063.stdout: Package Architecture Version Repository Size 2024-02-22T18:35:05.663 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-02-22T18:35:05.664 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2024-02-22T18:35:05.664 INFO:teuthology.orchestra.run.smithi063.stdout: kernel x86_64 4.18.0-540.el8 baseos 10 M 2024-02-22T18:35:05.664 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-02-22T18:35:05.664 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-core x86_64 4.18.0-540.el8 baseos 44 M 2024-02-22T18:35:05.664 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules x86_64 4.18.0-540.el8 baseos 36 M 2024-02-22T18:35:05.664 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-02-22T18:35:05.664 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-02-22T18:35:05.664 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-02-22T18:35:05.664 INFO:teuthology.orchestra.run.smithi063.stdout:Install 3 Packages 2024-02-22T18:35:05.664 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-02-22T18:35:05.665 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 90 M 2024-02-22T18:35:05.665 INFO:teuthology.orchestra.run.smithi063.stdout:Installed size: 97 M 2024-02-22T18:35:05.665 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-02-22T18:35:06.464 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 413 kB/s | 24 kB 00:00 2024-02-22T18:35:09.678 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-22T18:35:09.678 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-22T18:35:09.788 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-22T18:35:09.789 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-22T18:35:09.789 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-02-22T18:35:09.789 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-22T18:35:09.789 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-02-22T18:35:09.789 INFO:teuthology.orchestra.run.smithi062.stdout: kernel x86_64 4.18.0-540.el8 baseos 10 M 2024-02-22T18:35:09.789 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-02-22T18:35:09.789 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-core x86_64 4.18.0-540.el8 baseos 44 M 2024-02-22T18:35:09.789 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules x86_64 4.18.0-540.el8 baseos 36 M 2024-02-22T18:35:09.789 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T18:35:09.790 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-22T18:35:09.790 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-22T18:35:09.790 INFO:teuthology.orchestra.run.smithi062.stdout:Install 3 Packages 2024-02-22T18:35:09.790 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T18:35:09.790 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 90 M 2024-02-22T18:35:09.790 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 97 M 2024-02-22T18:35:09.791 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-22T18:39:16.471 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-4.18.0-540.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/BaseOS/x86_64/os/Packages/kernel-4.18.0-540.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2024-02-22T18:39:16.471 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-core-4.18.0-540.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/BaseOS/x86_64/os/Packages/kernel-core-4.18.0-540.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2024-02-22T18:39:18.988 INFO:teuthology.orchestra.run.smithi062.stdout:(1/3): kernel-4.18.0-540.el8.x86_64.rpm 42 kB/s | 10 MB 04:08 2024-02-22T18:39:19.876 INFO:teuthology.orchestra.run.smithi063.stdout:[MIRROR] kernel-core-4.18.0-540.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/BaseOS/x86_64/os/Packages/kernel-core-4.18.0-540.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2024-02-22T18:39:19.876 INFO:teuthology.orchestra.run.smithi063.stdout:[MIRROR] kernel-4.18.0-540.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/BaseOS/x86_64/os/Packages/kernel-4.18.0-540.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2024-02-22T18:39:19.885 INFO:teuthology.orchestra.run.smithi063.stdout:[MIRROR] kernel-modules-4.18.0-540.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/BaseOS/x86_64/os/Packages/kernel-modules-4.18.0-540.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2024-02-22T18:39:20.230 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] kernel-modules-4.18.0-540.el8.x86_64.rpm: Curl error (56): Failure when receiving data from the peer for http://mirrors.cmich.edu/centos/8-stream/BaseOS/x86_64/os/Packages/kernel-modules-4.18.0-540.el8.x86_64.rpm [Recv failure: Connection reset by peer] 2024-02-22T18:39:21.266 INFO:teuthology.orchestra.run.smithi063.stdout:(1/3): kernel-4.18.0-540.el8.x86_64.rpm 42 kB/s | 10 MB 04:12 2024-02-22T18:39:21.796 INFO:teuthology.orchestra.run.smithi062.stdout:(2/3): kernel-core-4.18.0-540.el8.x86_64.rpm 177 kB/s | 44 MB 04:11 2024-02-22T18:39:22.725 INFO:teuthology.orchestra.run.smithi063.stdout:(2/3): kernel-modules-4.18.0-540.el8.x86_64.rpm 147 kB/s | 36 MB 04:13 2024-02-22T18:39:24.813 INFO:teuthology.orchestra.run.smithi062.stdout:(3/3): kernel-modules-4.18.0-540.el8.x86_64.rpm 146 kB/s | 36 MB 04:14 2024-02-22T18:39:24.813 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-22T18:39:24.813 INFO:teuthology.orchestra.run.smithi062.stdout:Total 362 kB/s | 90 MB 04:15 2024-02-22T18:39:25.523 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-22T18:39:25.984 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-22T18:39:25.984 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-22T18:39:27.344 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-22T18:39:27.383 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-22T18:39:30.340 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-22T18:39:30.859 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-core-4.18.0-540.el8.x86_64 1/3 2024-02-22T18:39:34.606 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-core-4.18.0-540.el8.x86_64 1/3 2024-02-22T18:39:34.992 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-modules-4.18.0-540.el8.x86_64 2/3 2024-02-22T18:39:38.672 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-4.18.0-540.el8.x86_64 2/3 2024-02-22T18:39:38.980 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-4.18.0-540.el8.x86_64 3/3 2024-02-22T18:39:41.615 INFO:teuthology.orchestra.run.smithi063.stdout:(3/3): kernel-core-4.18.0-540.el8.x86_64.rpm 164 kB/s | 44 MB 04:32 2024-02-22T18:39:41.615 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-02-22T18:39:41.615 INFO:teuthology.orchestra.run.smithi063.stdout:Total 335 kB/s | 90 MB 04:35 2024-02-22T18:39:42.446 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-02-22T18:39:42.893 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-02-22T18:39:42.893 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-02-22T18:39:44.180 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-02-22T18:39:44.215 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-02-22T18:39:47.193 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-02-22T18:39:47.779 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-core-4.18.0-540.el8.x86_64 1/3 2024-02-22T18:39:51.582 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-core-4.18.0-540.el8.x86_64 1/3 2024-02-22T18:39:51.971 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-modules-4.18.0-540.el8.x86_64 2/3 2024-02-22T18:39:55.651 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-4.18.0-540.el8.x86_64 2/3 2024-02-22T18:39:55.931 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-4.18.0-540.el8.x86_64 3/3 2024-02-22T18:40:02.383 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-core-4.18.0-540.el8.x86_64 3/3 2024-02-22T18:40:02.406 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-4.18.0-540.el8.x86_64 3/3 2024-02-22T18:40:02.757 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-4.18.0-540.el8.x86_64 3/3 2024-02-22T18:40:02.757 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-4.18.0-540.el8.x86_64 1/3 2024-02-22T18:40:02.757 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-core-4.18.0-540.el8.x86_64 2/3 2024-02-22T18:40:03.270 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-modules-4.18.0-540.el8.x86_64 3/3 2024-02-22T18:40:03.270 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T18:40:03.270 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-22T18:40:03.270 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-4.18.0-540.el8.x86_64 kernel-core-4.18.0-540.el8.x86_64 2024-02-22T18:40:03.270 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-4.18.0-540.el8.x86_64 2024-02-22T18:40:03.270 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T18:40:03.270 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-22T18:40:03.468 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel | sort -rV | head -n 1 2024-02-22T18:40:03.749 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-4.18.0-540.el8.x86_64 2024-02-22T18:40:03.750 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-540.el8.x86_64 2024-02-22T18:40:03.750 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-540.el8.x86_64 2024-02-22T18:40:03.750 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-22T18:40:03.750 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-22T18:40:03.750 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-02-22T18:40:03.750 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi062.front.sepia.ceph.com, path=None, version=distro) 2024-02-22T18:40:03.750 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel | sort -rV | head -n 1 2024-02-22T18:40:03.973 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-4.18.0-540.el8.x86_64 2024-02-22T18:40:03.974 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-540.el8.x86_64 2024-02-22T18:40:03.974 DEBUG:teuthology.orchestra.run.smithi062:> sudo rpm -qi grub2-tools 2024-02-22T18:40:04.008 INFO:teuthology.orchestra.run.smithi062.stdout:Name : grub2-tools 2024-02-22T18:40:04.008 INFO:teuthology.orchestra.run.smithi062.stdout:Epoch : 1 2024-02-22T18:40:04.008 INFO:teuthology.orchestra.run.smithi062.stdout:Version : 2.02 2024-02-22T18:40:04.008 INFO:teuthology.orchestra.run.smithi062.stdout:Release : 129.el8 2024-02-22T18:40:04.009 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: x86_64 2024-02-22T18:40:04.009 INFO:teuthology.orchestra.run.smithi062.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-22T18:40:04.009 INFO:teuthology.orchestra.run.smithi062.stdout:Group : System Environment/Base 2024-02-22T18:40:04.009 INFO:teuthology.orchestra.run.smithi062.stdout:Size : 9265586 2024-02-22T18:40:04.009 INFO:teuthology.orchestra.run.smithi062.stdout:License : GPLv3+ 2024-02-22T18:40:04.009 INFO:teuthology.orchestra.run.smithi062.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-22T18:40:04.009 INFO:teuthology.orchestra.run.smithi062.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-22T18:40:04.009 INFO:teuthology.orchestra.run.smithi062.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-22T18:40:04.009 INFO:teuthology.orchestra.run.smithi062.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-22T18:40:04.009 INFO:teuthology.orchestra.run.smithi062.stdout:Relocations : (not relocatable) 2024-02-22T18:40:04.009 INFO:teuthology.orchestra.run.smithi062.stdout:Packager : CentOS BuildSystem 2024-02-22T18:40:04.009 INFO:teuthology.orchestra.run.smithi062.stdout:Vendor : CentOS 2024-02-22T18:40:04.009 INFO:teuthology.orchestra.run.smithi062.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-22T18:40:04.009 INFO:teuthology.orchestra.run.smithi062.stdout:Summary : Support tools for GRUB. 2024-02-22T18:40:04.010 INFO:teuthology.orchestra.run.smithi062.stdout:Description : 2024-02-22T18:40:04.010 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T18:40:04.010 INFO:teuthology.orchestra.run.smithi062.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-22T18:40:04.010 INFO:teuthology.orchestra.run.smithi062.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-22T18:40:04.010 INFO:teuthology.orchestra.run.smithi062.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-22T18:40:04.010 INFO:teuthology.orchestra.run.smithi062.stdout:hardware devices. 2024-02-22T18:40:04.010 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T18:40:04.010 INFO:teuthology.orchestra.run.smithi062.stdout:This subpackage provides tools for support of all platforms. 2024-02-22T18:40:04.011 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-22T18:40:04.011 INFO:teuthology.task.kernel:Updating grub on smithi062 to boot 4.18.0-540.el8.x86_64 2024-02-22T18:40:04.011 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-22T18:40:05.418 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2024-02-22T18:40:07.649 INFO:teuthology.orchestra.run.smithi062.stderr:done 2024-02-22T18:40:07.651 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-02-22T18:40:07.675 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.6GGRs1wdpt 2024-02-22T18:40:07.676 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.6GGRs1wdpt 2024-02-22T18:40:07.748 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.6GGRs1wdpt 2024-02-22T18:40:07.897 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.6GGRs1wdpt is 6KB 2024-02-22T18:40:07.945 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.6GGRs1wdpt 2024-02-22T18:40:07.963 DEBUG:teuthology.orchestra.run.smithi062:> sudo /bin/ls /boot/loader/entries || true 2024-02-22T18:40:08.036 INFO:teuthology.orchestra.run.smithi062.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-22T18:40:08.036 INFO:teuthology.orchestra.run.smithi062.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-22T18:40:08.036 INFO:teuthology.orchestra.run.smithi062.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-22T18:40:08.037 INFO:teuthology.orchestra.run.smithi062.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-540.el8.x86_64.conf 2024-02-22T18:40:08.038 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-540.el8.x86_64 2024-02-22T18:40:08.204 DEBUG:teuthology.orchestra.run.smithi062:> sudo shutdown -r now 2024-02-22T18:40:19.344 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-core-4.18.0-540.el8.x86_64 3/3 2024-02-22T18:40:19.366 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-modules-4.18.0-540.el8.x86_64 3/3 2024-02-22T18:40:19.731 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-4.18.0-540.el8.x86_64 3/3 2024-02-22T18:40:19.731 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-4.18.0-540.el8.x86_64 1/3 2024-02-22T18:40:19.731 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-core-4.18.0-540.el8.x86_64 2/3 2024-02-22T18:40:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-modules-4.18.0-540.el8.x86_64 3/3 2024-02-22T18:40:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-02-22T18:40:20.355 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-02-22T18:40:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-4.18.0-540.el8.x86_64 kernel-core-4.18.0-540.el8.x86_64 2024-02-22T18:40:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-modules-4.18.0-540.el8.x86_64 2024-02-22T18:40:20.355 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-02-22T18:40:20.355 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-02-22T18:40:20.513 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q kernel | sort -rV | head -n 1 2024-02-22T18:40:20.740 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-4.18.0-540.el8.x86_64 2024-02-22T18:40:20.740 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-540.el8.x86_64 2024-02-22T18:40:20.740 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-540.el8.x86_64 2024-02-22T18:40:20.741 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-22T18:40:20.741 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-22T18:40:20.741 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-02-22T18:40:20.741 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi063.front.sepia.ceph.com, path=None, version=distro) 2024-02-22T18:40:20.741 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q kernel | sort -rV | head -n 1 2024-02-22T18:40:20.960 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-4.18.0-540.el8.x86_64 2024-02-22T18:40:20.961 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-540.el8.x86_64 2024-02-22T18:40:20.961 DEBUG:teuthology.orchestra.run.smithi063:> sudo rpm -qi grub2-tools 2024-02-22T18:40:20.995 INFO:teuthology.orchestra.run.smithi063.stdout:Name : grub2-tools 2024-02-22T18:40:20.995 INFO:teuthology.orchestra.run.smithi063.stdout:Epoch : 1 2024-02-22T18:40:20.995 INFO:teuthology.orchestra.run.smithi063.stdout:Version : 2.02 2024-02-22T18:40:20.995 INFO:teuthology.orchestra.run.smithi063.stdout:Release : 129.el8 2024-02-22T18:40:20.995 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: x86_64 2024-02-22T18:40:20.996 INFO:teuthology.orchestra.run.smithi063.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-22T18:40:20.996 INFO:teuthology.orchestra.run.smithi063.stdout:Group : System Environment/Base 2024-02-22T18:40:20.996 INFO:teuthology.orchestra.run.smithi063.stdout:Size : 9265586 2024-02-22T18:40:20.996 INFO:teuthology.orchestra.run.smithi063.stdout:License : GPLv3+ 2024-02-22T18:40:20.996 INFO:teuthology.orchestra.run.smithi063.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-22T18:40:20.996 INFO:teuthology.orchestra.run.smithi063.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-22T18:40:20.996 INFO:teuthology.orchestra.run.smithi063.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-22T18:40:20.996 INFO:teuthology.orchestra.run.smithi063.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-22T18:40:20.996 INFO:teuthology.orchestra.run.smithi063.stdout:Relocations : (not relocatable) 2024-02-22T18:40:20.996 INFO:teuthology.orchestra.run.smithi063.stdout:Packager : CentOS BuildSystem 2024-02-22T18:40:20.996 INFO:teuthology.orchestra.run.smithi063.stdout:Vendor : CentOS 2024-02-22T18:40:20.996 INFO:teuthology.orchestra.run.smithi063.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-22T18:40:20.996 INFO:teuthology.orchestra.run.smithi063.stdout:Summary : Support tools for GRUB. 2024-02-22T18:40:20.997 INFO:teuthology.orchestra.run.smithi063.stdout:Description : 2024-02-22T18:40:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-02-22T18:40:20.997 INFO:teuthology.orchestra.run.smithi063.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-22T18:40:20.997 INFO:teuthology.orchestra.run.smithi063.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-22T18:40:20.997 INFO:teuthology.orchestra.run.smithi063.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-22T18:40:20.997 INFO:teuthology.orchestra.run.smithi063.stdout:hardware devices. 2024-02-22T18:40:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-02-22T18:40:20.997 INFO:teuthology.orchestra.run.smithi063.stdout:This subpackage provides tools for support of all platforms. 2024-02-22T18:40:20.998 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-22T18:40:20.998 INFO:teuthology.task.kernel:Updating grub on smithi063 to boot 4.18.0-540.el8.x86_64 2024-02-22T18:40:20.998 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-22T18:40:22.445 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2024-02-22T18:40:24.179 INFO:teuthology.orchestra.run.smithi063.stderr:done 2024-02-22T18:40:24.181 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2024-02-22T18:40:24.203 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.VyEjYN752j 2024-02-22T18:40:24.203 DEBUG:teuthology.orchestra.run.smithi063:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.VyEjYN752j 2024-02-22T18:40:24.274 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.VyEjYN752j 2024-02-22T18:40:24.422 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.VyEjYN752j is 6KB 2024-02-22T18:40:24.471 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.VyEjYN752j 2024-02-22T18:40:24.488 DEBUG:teuthology.orchestra.run.smithi063:> sudo /bin/ls /boot/loader/entries || true 2024-02-22T18:40:24.564 INFO:teuthology.orchestra.run.smithi063.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-22T18:40:24.564 INFO:teuthology.orchestra.run.smithi063.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-22T18:40:24.564 INFO:teuthology.orchestra.run.smithi063.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-22T18:40:24.564 INFO:teuthology.orchestra.run.smithi063.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-540.el8.x86_64.conf 2024-02-22T18:40:24.565 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-540.el8.x86_64 2024-02-22T18:40:24.872 DEBUG:teuthology.orchestra.run.smithi063:> sudo shutdown -r now 2024-02-22T18:40:38.216 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-22T18:40:38.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-02-22T18:40:38.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T18:40:54.889 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-02-22T18:40:54.889 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-02-22T18:40:54.890 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T18:40:56.636 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-02-22T18:41:05.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-02-22T18:41:05.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T18:41:08.700 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-02-22T18:41:13.276 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-22T18:41:20.708 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-02-22T18:41:20.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T18:41:22.278 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-02-22T18:41:22.279 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T18:41:25.340 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-22T18:41:37.353 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-02-22T18:41:37.354 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T18:41:53.136 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-02-22T18:41:54.511 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-02-22T18:41:54.512 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-540.el8.x86_64"... 2024-02-22T18:41:54.512 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-02-22T18:41:54.531 INFO:teuthology.orchestra.run.smithi062.stdout:4.18.0-540.el8.x86_64 2024-02-22T18:41:54.532 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-540.el8.x86_64 vs 4.18.0-540.el8.x86_64 2024-02-22T18:41:54.532 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-22T18:41:54.532 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-22T18:41:55.533 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-22T18:41:55.533 DEBUG:teuthology.orchestra.run.smithi062:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-22T18:41:55.626 INFO:teuthology.orchestra.run.smithi062.stdout:ttyS1 2024-02-22T18:41:55.641 DEBUG:teuthology.parallel:result is None 2024-02-22T18:41:55.772 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2024-02-22T18:42:10.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-02-22T18:42:10.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T18:42:11.196 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-02-22T18:42:11.458 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-02-22T18:42:11.458 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-540.el8.x86_64"... 2024-02-22T18:42:11.458 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2024-02-22T18:42:11.476 INFO:teuthology.orchestra.run.smithi063.stdout:4.18.0-540.el8.x86_64 2024-02-22T18:42:11.476 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-540.el8.x86_64 vs 4.18.0-540.el8.x86_64 2024-02-22T18:42:11.476 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-22T18:42:11.476 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-22T18:42:12.477 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-02-22T18:42:12.478 DEBUG:teuthology.orchestra.run.smithi063:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-22T18:42:12.634 INFO:teuthology.orchestra.run.smithi063.stdout:ttyS1 2024-02-22T18:42:12.649 DEBUG:teuthology.parallel:result is None 2024-02-22T18:42:12.649 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-22T18:42:12.657 INFO:teuthology.task.internal:Creating test directory... 2024-02-22T18:42:12.657 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-22T18:42:12.663 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-22T18:42:12.987 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-22T18:42:12.994 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-22T18:42:13.001 INFO:teuthology.task.internal:Creating archive directory... 2024-02-22T18:42:13.001 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-22T18:42:13.003 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-22T18:42:13.324 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-22T18:42:13.331 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-22T18:42:13.331 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-22T18:42:13.334 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-22T18:42:13.389 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-22T18:42:13.401 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-22T18:42:13.896 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-22T18:42:13.951 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-22T18:42:13.954 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-22T18:42:13.962 INFO:teuthology.task.internal:Configuring sudo... 2024-02-22T18:42:13.962 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-22T18:42:13.965 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-22T18:42:14.260 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-22T18:42:14.269 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-22T18:42:14.269 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-22T18:42:14.271 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-22T18:42:14.294 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-22T18:42:14.384 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-22T18:42:14.448 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-22T18:42:14.495 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-22T18:42:14.541 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-22T18:42:14.541 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-22T18:42:14.610 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-22T18:42:14.722 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-22T18:42:14.773 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-22T18:42:14.816 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-22T18:42:14.860 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-02-22T18:42:14.861 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-22T18:42:14.930 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2024-02-22T18:42:14.933 DEBUG:teuthology.orchestra.run.smithi063:> sudo service rsyslog restart 2024-02-22T18:42:15.011 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-22T18:42:15.030 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-22T18:42:15.247 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-22T18:42:15.255 INFO:teuthology.task.internal:Starting timer... 2024-02-22T18:42:15.255 INFO:teuthology.run_tasks:Running task pcp... 2024-02-22T18:42:15.265 INFO:teuthology.run_tasks:Running task selinux... 2024-02-22T18:42:15.273 DEBUG:teuthology.orchestra.run.smithi062:> sudo service auditd rotate 2024-02-22T18:42:15.377 INFO:teuthology.orchestra.run.smithi062.stdout:Rotating logs: 2024-02-22T18:42:15.379 DEBUG:teuthology.orchestra.run.smithi063:> sudo service auditd rotate 2024-02-22T18:42:15.455 INFO:teuthology.orchestra.run.smithi063.stdout:Rotating logs: 2024-02-22T18:42:15.457 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-22T18:42:15.457 DEBUG:teuthology.orchestra.run.smithi062:> /usr/sbin/getenforce 2024-02-22T18:42:15.524 INFO:teuthology.orchestra.run.smithi062.stdout:Permissive 2024-02-22T18:42:15.525 DEBUG:teuthology.orchestra.run.smithi063:> /usr/sbin/getenforce 2024-02-22T18:42:15.560 INFO:teuthology.orchestra.run.smithi063.stdout:Permissive 2024-02-22T18:42:15.560 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi062.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi063.front.sepia.ceph.com': 'permissive'} 2024-02-22T18:42:15.560 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-22T18:42:15.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-22T18:42:15.590 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-22T18:42:15.627 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-22T18:42:15.627 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-22T18:42:15.627 DEBUG:teuthology.orchestra.run.smithi062:> sudo /usr/sbin/setenforce permissive 2024-02-22T18:42:15.658 DEBUG:teuthology.orchestra.run.smithi063:> sudo /usr/sbin/setenforce permissive 2024-02-22T18:42:15.702 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-22T18:42:15.713 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-22T18:42:15.731 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-22T18:42:15.732 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi062.front.sepia.ceph.com,smithi063.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-22T19:00:58.760 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi062.front.sepia.ceph.com'), Remote(name='ubuntu@smithi063.front.sepia.ceph.com')] 2024-02-22T19:00:58.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-02-22T19:00:58.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T19:00:58.837 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-02-22T19:00:58.907 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-02-22T19:00:58.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-02-22T19:00:58.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-22T19:00:58.984 DEBUG:teuthology.orchestra.run.smithi063:> true 2024-02-22T19:00:59.057 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2024-02-22T19:00:59.057 INFO:teuthology.run_tasks:Running task clock... 2024-02-22T19:00:59.068 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-22T19:00:59.069 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-22T19:00:59.069 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-22T19:00:59.071 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-22T19:00:59.071 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-22T19:00:59.103 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-22T19:00:59.118 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-22T19:00:59.133 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-22T19:00:59.148 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-22T19:00:59.182 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: ntpd: command not found 2024-02-22T19:00:59.193 INFO:teuthology.orchestra.run.smithi062.stdout:506 Cannot talk to daemon 2024-02-22T19:00:59.207 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-22T19:00:59.215 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: ntpd: command not found 2024-02-22T19:00:59.221 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-22T19:00:59.227 INFO:teuthology.orchestra.run.smithi063.stdout:506 Cannot talk to daemon 2024-02-22T19:00:59.241 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-22T19:00:59.254 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-22T19:00:59.287 INFO:teuthology.orchestra.run.smithi062.stderr:bash: ntpq: command not found 2024-02-22T19:00:59.291 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-22T19:00:59.291 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-02-22T19:00:59.291 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-22T19:00:59.291 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-22T19:00:59.291 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-22T19:00:59.291 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-22T19:00:59.324 INFO:teuthology.orchestra.run.smithi063.stderr:bash: ntpq: command not found 2024-02-22T19:00:59.327 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-22T19:00:59.327 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-02-22T19:00:59.327 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-22T19:00:59.327 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-22T19:00:59.327 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-22T19:00:59.327 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-22T19:00:59.328 INFO:teuthology.run_tasks:Running task pexec... 2024-02-22T19:00:59.337 INFO:teuthology.task.pexec:Executing custom commands... 2024-02-22T19:00:59.338 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi062.front.sepia.ceph.com 2024-02-22T19:00:59.338 DEBUG:teuthology.orchestra.run.smithi062:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-22T19:00:59.338 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi063.front.sepia.ceph.com 2024-02-22T19:00:59.338 DEBUG:teuthology.orchestra.run.smithi063:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-22T19:01:00.157 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:05:39 ago on Thu 22 Feb 2024 06:55:20 PM UTC. 2024-02-22T19:01:00.184 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:05:35 ago on Thu 22 Feb 2024 06:55:25 PM UTC. 2024-02-22T19:01:02.368 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-22T19:01:02.369 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-22T19:01:02.369 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-02-22T19:01:02.369 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-22T19:01:02.369 INFO:teuthology.orchestra.run.smithi062.stdout:Resetting modules: 2024-02-22T19:01:02.369 INFO:teuthology.orchestra.run.smithi062.stdout: container-tools 2024-02-22T19:01:02.369 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T19:01:02.370 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-22T19:01:02.370 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-02-22T19:01:02.370 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T19:01:02.389 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-02-22T19:01:02.390 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-02-22T19:01:02.390 INFO:teuthology.orchestra.run.smithi063.stdout: Package Architecture Version Repository Size 2024-02-22T19:01:02.390 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-02-22T19:01:02.390 INFO:teuthology.orchestra.run.smithi063.stdout:Resetting modules: 2024-02-22T19:01:02.390 INFO:teuthology.orchestra.run.smithi063.stdout: container-tools 2024-02-22T19:01:02.390 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-02-22T19:01:02.391 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-02-22T19:01:02.391 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2024-02-22T19:01:02.391 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-02-22T19:01:02.644 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-22T19:01:02.670 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-02-22T19:01:03.541 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:05:43 ago on Thu 22 Feb 2024 06:55:20 PM UTC. 2024-02-22T19:01:03.563 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:05:38 ago on Thu 22 Feb 2024 06:55:25 PM UTC. 2024-02-22T19:01:05.751 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-02-22T19:01:05.755 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================================ 2024-02-22T19:01:05.755 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repo Size 2024-02-22T19:01:05.755 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================================ 2024-02-22T19:01:05.755 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrading: 2024-02-22T19:01:05.755 INFO:teuthology.orchestra.run.smithi062.stdout: conmon x86_64 3:2.1.10-1.module_el8+804+f131391c appstream 58 k 2024-02-22T19:01:05.755 INFO:teuthology.orchestra.run.smithi062.stdout: container-selinux noarch 2:2.229.0-2.module_el8+847+7863d4e6 appstream 71 k 2024-02-22T19:01:05.755 INFO:teuthology.orchestra.run.smithi062.stdout: containernetworking-plugins x86_64 1:1.4.0-1.module_el8+804+f131391c appstream 22 M 2024-02-22T19:01:05.755 INFO:teuthology.orchestra.run.smithi062.stdout: containers-common x86_64 2:1-80.module_el8+954+1d378e5e appstream 148 k 2024-02-22T19:01:05.755 INFO:teuthology.orchestra.run.smithi062.stdout: criu x86_64 3.18-4.module_el8+804+f131391c appstream 564 k 2024-02-22T19:01:05.756 INFO:teuthology.orchestra.run.smithi062.stdout: fuse-overlayfs x86_64 1.13-1.module_el8+804+f131391c appstream 70 k 2024-02-22T19:01:05.756 INFO:teuthology.orchestra.run.smithi062.stdout: libslirp x86_64 4.4.0-1.module_el8+804+f131391c appstream 70 k 2024-02-22T19:01:05.756 INFO:teuthology.orchestra.run.smithi062.stdout: runc x86_64 1:1.1.12-1.module_el8+885+7da147f3 appstream 3.1 M 2024-02-22T19:01:05.756 INFO:teuthology.orchestra.run.smithi062.stdout: slirp4netns x86_64 1.2.3-1.module_el8+951+32019cde appstream 56 k 2024-02-22T19:01:05.756 INFO:teuthology.orchestra.run.smithi062.stdout:Installing group/module packages: 2024-02-22T19:01:05.756 INFO:teuthology.orchestra.run.smithi062.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-02-22T19:01:05.756 INFO:teuthology.orchestra.run.smithi062.stdout: buildah x86_64 2:1.33.5-1.module_el8+885+7da147f3 appstream 9.7 M 2024-02-22T19:01:05.756 INFO:teuthology.orchestra.run.smithi062.stdout: cockpit-podman noarch 83-1.module_el8+847+7863d4e6 appstream 688 k 2024-02-22T19:01:05.756 INFO:teuthology.orchestra.run.smithi062.stdout: crun x86_64 1.14.1-1.module_el8+951+32019cde appstream 257 k 2024-02-22T19:01:05.756 INFO:teuthology.orchestra.run.smithi062.stdout: netavark x86_64 2:1.10.3-1.module_el8+951+32019cde appstream 4.1 M 2024-02-22T19:01:05.756 INFO:teuthology.orchestra.run.smithi062.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-02-22T19:01:05.756 INFO:teuthology.orchestra.run.smithi062.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-02-22T19:01:05.756 INFO:teuthology.orchestra.run.smithi062.stdout: toolbox x86_64 0.0.99.5-1.module_el8+847+7863d4e6 appstream 2.5 M 2024-02-22T19:01:05.756 INFO:teuthology.orchestra.run.smithi062.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-02-22T19:01:05.757 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-02-22T19:01:05.757 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-02-22T19:01:05.757 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-02-22T19:01:05.757 INFO:teuthology.orchestra.run.smithi062.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-02-22T19:01:05.757 INFO:teuthology.orchestra.run.smithi062.stdout:Installing weak dependencies: 2024-02-22T19:01:05.757 INFO:teuthology.orchestra.run.smithi062.stdout: criu-libs x86_64 3.18-4.module_el8+804+f131391c appstream 39 k 2024-02-22T19:01:05.757 INFO:teuthology.orchestra.run.smithi062.stdout:Installing module profiles: 2024-02-22T19:01:05.757 INFO:teuthology.orchestra.run.smithi062.stdout: container-tools/common 2024-02-22T19:01:05.757 INFO:teuthology.orchestra.run.smithi062.stdout:Enabling module streams: 2024-02-22T19:01:05.757 INFO:teuthology.orchestra.run.smithi062.stdout: container-tools rhel8 2024-02-22T19:01:05.757 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T19:01:05.757 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-02-22T19:01:05.757 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================================ 2024-02-22T19:01:05.757 INFO:teuthology.orchestra.run.smithi062.stdout:Install 13 Packages 2024-02-22T19:01:05.757 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade 9 Packages 2024-02-22T19:01:05.757 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T19:01:05.758 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 54 M 2024-02-22T19:01:05.758 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-02-22T19:01:05.766 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2024-02-22T19:01:05.770 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================================ 2024-02-22T19:01:05.770 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repo Size 2024-02-22T19:01:05.770 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================================ 2024-02-22T19:01:05.770 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrading: 2024-02-22T19:01:05.770 INFO:teuthology.orchestra.run.smithi063.stdout: conmon x86_64 3:2.1.10-1.module_el8+804+f131391c appstream 58 k 2024-02-22T19:01:05.770 INFO:teuthology.orchestra.run.smithi063.stdout: container-selinux noarch 2:2.229.0-2.module_el8+847+7863d4e6 appstream 71 k 2024-02-22T19:01:05.770 INFO:teuthology.orchestra.run.smithi063.stdout: containernetworking-plugins x86_64 1:1.4.0-1.module_el8+804+f131391c appstream 22 M 2024-02-22T19:01:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: containers-common x86_64 2:1-80.module_el8+954+1d378e5e appstream 148 k 2024-02-22T19:01:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: criu x86_64 3.18-4.module_el8+804+f131391c appstream 564 k 2024-02-22T19:01:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: fuse-overlayfs x86_64 1.13-1.module_el8+804+f131391c appstream 70 k 2024-02-22T19:01:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: libslirp x86_64 4.4.0-1.module_el8+804+f131391c appstream 70 k 2024-02-22T19:01:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: runc x86_64 1:1.1.12-1.module_el8+885+7da147f3 appstream 3.1 M 2024-02-22T19:01:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: slirp4netns x86_64 1.2.3-1.module_el8+951+32019cde appstream 56 k 2024-02-22T19:01:05.771 INFO:teuthology.orchestra.run.smithi063.stdout:Installing group/module packages: 2024-02-22T19:01:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-02-22T19:01:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: buildah x86_64 2:1.33.5-1.module_el8+885+7da147f3 appstream 9.7 M 2024-02-22T19:01:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: cockpit-podman noarch 83-1.module_el8+847+7863d4e6 appstream 688 k 2024-02-22T19:01:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: crun x86_64 1.14.1-1.module_el8+951+32019cde appstream 257 k 2024-02-22T19:01:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: netavark x86_64 2:1.10.3-1.module_el8+951+32019cde appstream 4.1 M 2024-02-22T19:01:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-02-22T19:01:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-02-22T19:01:05.771 INFO:teuthology.orchestra.run.smithi063.stdout: toolbox x86_64 0.0.99.5-1.module_el8+847+7863d4e6 appstream 2.5 M 2024-02-22T19:01:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-02-22T19:01:05.772 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2024-02-22T19:01:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-02-22T19:01:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-02-22T19:01:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-02-22T19:01:05.772 INFO:teuthology.orchestra.run.smithi063.stdout:Installing weak dependencies: 2024-02-22T19:01:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: criu-libs x86_64 3.18-4.module_el8+804+f131391c appstream 39 k 2024-02-22T19:01:05.772 INFO:teuthology.orchestra.run.smithi063.stdout:Installing module profiles: 2024-02-22T19:01:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: container-tools/common 2024-02-22T19:01:05.772 INFO:teuthology.orchestra.run.smithi063.stdout:Enabling module streams: 2024-02-22T19:01:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: container-tools rhel8 2024-02-22T19:01:05.772 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-02-22T19:01:05.772 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2024-02-22T19:01:05.772 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================================ 2024-02-22T19:01:05.773 INFO:teuthology.orchestra.run.smithi063.stdout:Install 13 Packages 2024-02-22T19:01:05.773 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrade 9 Packages 2024-02-22T19:01:05.773 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-02-22T19:01:05.773 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 54 M 2024-02-22T19:01:05.773 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2024-02-22T19:01:07.135 INFO:teuthology.orchestra.run.smithi062.stdout:(1/22): cockpit-podman-83-1.module_el8+847+7863 522 kB/s | 688 kB 00:01 2024-02-22T19:01:07.189 INFO:teuthology.orchestra.run.smithi063.stdout:(1/22): cockpit-podman-83-1.module_el8+847+7863 504 kB/s | 688 kB 00:01 2024-02-22T19:01:07.251 INFO:teuthology.orchestra.run.smithi063.stdout:(2/22): aardvark-dns-1.10.0-1.module_el8+871+55 723 kB/s | 1.0 MB 00:01 2024-02-22T19:01:07.285 INFO:teuthology.orchestra.run.smithi062.stdout:(2/22): aardvark-dns-1.10.0-1.module_el8+871+55 702 kB/s | 1.0 MB 00:01 2024-02-22T19:01:07.529 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] crun-1.14.1-1.module_el8+951+32019cde.x86_64.rpm: Status code: 503 for http://mirrors.rcs.alaska.edu/centos/8-stream/AppStream/x86_64/os/Packages/crun-1.14.1-1.module_el8%2b951%2b32019cde.x86_64.rpm (IP: 199.165.82.202) 2024-02-22T19:01:07.694 INFO:teuthology.orchestra.run.smithi062.stdout:(3/22): criu-libs-3.18-4.module_el8+804+f131391 70 kB/s | 39 kB 00:00 2024-02-22T19:01:07.752 INFO:teuthology.orchestra.run.smithi063.stdout:(3/22): criu-libs-3.18-4.module_el8+804+f131391 70 kB/s | 39 kB 00:00 2024-02-22T19:01:07.769 INFO:teuthology.orchestra.run.smithi062.stdout:(4/22): crun-1.14.1-1.module_el8+951+32019cde.x 533 kB/s | 257 kB 00:00 2024-02-22T19:01:07.937 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] netavark-1.10.3-1.module_el8+951+32019cde.x86_64.rpm: Status code: 503 for http://mirrors.rcs.alaska.edu/centos/8-stream/AppStream/x86_64/os/Packages/netavark-1.10.3-1.module_el8%2b951%2b32019cde.x86_64.rpm (IP: 199.165.82.202) 2024-02-22T19:01:07.997 INFO:teuthology.orchestra.run.smithi063.stdout:[MIRROR] netavark-1.10.3-1.module_el8+951+32019cde.x86_64.rpm: Status code: 503 for http://mirrors.rcs.alaska.edu/centos/8-stream/AppStream/x86_64/os/Packages/netavark-1.10.3-1.module_el8%2b951%2b32019cde.x86_64.rpm (IP: 199.165.82.202) 2024-02-22T19:01:08.014 INFO:teuthology.orchestra.run.smithi062.stdout:[MIRROR] python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch.rpm: Status code: 503 for http://mirrors.rcs.alaska.edu/centos/8-stream/AppStream/x86_64/os/Packages/python3-podman-4.9.0-1.module_el8%2b847%2b7863d4e6.noarch.rpm (IP: 199.165.82.202) 2024-02-22T19:01:08.152 INFO:teuthology.orchestra.run.smithi063.stdout:(4/22): crun-1.14.1-1.module_el8+951+32019cde.x 286 kB/s | 257 kB 00:00 2024-02-22T19:01:08.286 INFO:teuthology.orchestra.run.smithi062.stdout:(5/22): netavark-1.10.3-1.module_el8+951+32019c 6.9 MB/s | 4.1 MB 00:00 2024-02-22T19:01:08.311 INFO:teuthology.orchestra.run.smithi062.stdout:(6/22): python3-podman-4.9.0-1.module_el8+847+7 333 kB/s | 180 kB 00:00 2024-02-22T19:01:08.336 INFO:teuthology.orchestra.run.smithi062.stdout:(7/22): python3-pytoml-0.1.14-5.git7dea353.el8. 492 kB/s | 25 kB 00:00 2024-02-22T19:01:08.378 INFO:teuthology.orchestra.run.smithi062.stdout:(8/22): python3-pyxdg-0.25-16.el8.noarch.rpm 1.4 MB/s | 94 kB 00:00 2024-02-22T19:01:08.644 INFO:teuthology.orchestra.run.smithi063.stdout:(5/22): netavark-1.10.3-1.module_el8+951+32019c 4.6 MB/s | 4.1 MB 00:00 2024-02-22T19:01:08.721 INFO:teuthology.orchestra.run.smithi062.stdout:(9/22): toolbox-0.0.99.5-1.module_el8+847+7863d 7.4 MB/s | 2.5 MB 00:00 2024-02-22T19:01:08.779 INFO:teuthology.orchestra.run.smithi062.stdout:(10/22): udica-0.2.6-20.module_el8+804+f131391c 906 kB/s | 53 kB 00:00 2024-02-22T19:01:08.863 INFO:teuthology.orchestra.run.smithi062.stdout:(11/22): yajl-2.1.0-12.el8.x86_64.rpm 492 kB/s | 41 kB 00:00 2024-02-22T19:01:08.913 INFO:teuthology.orchestra.run.smithi062.stdout:(12/22): conmon-2.1.10-1.module_el8+804+f131391 1.1 MB/s | 58 kB 00:00 2024-02-22T19:01:08.944 INFO:teuthology.orchestra.run.smithi063.stdout:(6/22): python3-podman-4.9.0-1.module_el8+847+7 228 kB/s | 180 kB 00:00 2024-02-22T19:01:08.980 INFO:teuthology.orchestra.run.smithi062.stdout:(13/22): container-selinux-2.229.0-2.module_el8 1.0 MB/s | 71 kB 00:00 2024-02-22T19:01:09.027 INFO:teuthology.orchestra.run.smithi063.stdout:(7/22): python3-pytoml-0.1.14-5.git7dea353.el8. 65 kB/s | 25 kB 00:00 2024-02-22T19:01:09.264 INFO:teuthology.orchestra.run.smithi062.stdout:(14/22): skopeo-1.14.3-0.1.module_el8+885+7da14 9.5 MB/s | 8.8 MB 00:00 2024-02-22T19:01:09.373 INFO:teuthology.orchestra.run.smithi062.stdout:(15/22): containers-common-1-80.module_el8+954+ 1.3 MB/s | 148 kB 00:00 2024-02-22T19:01:09.531 INFO:teuthology.orchestra.run.smithi062.stdout:(16/22): buildah-1.33.5-1.module_el8+885+7da147 2.6 MB/s | 9.7 MB 00:03 2024-02-22T19:01:09.565 INFO:teuthology.orchestra.run.smithi062.stdout:(17/22): criu-3.18-4.module_el8+804+f131391c.x8 2.9 MB/s | 564 kB 00:00 2024-02-22T19:01:09.736 INFO:teuthology.orchestra.run.smithi063.stdout:(8/22): buildah-1.33.5-1.module_el8+885+7da147f 2.5 MB/s | 9.7 MB 00:03 2024-02-22T19:01:09.757 INFO:teuthology.orchestra.run.smithi062.stdout:(18/22): libslirp-4.4.0-1.module_el8+804+f13139 367 kB/s | 70 kB 00:00 2024-02-22T19:01:09.788 INFO:teuthology.orchestra.run.smithi063.stdout:(9/22): python3-pyxdg-0.25-16.el8.noarch.rpm 111 kB/s | 94 kB 00:00 2024-02-22T19:01:09.816 INFO:teuthology.orchestra.run.smithi062.stdout:(19/22): fuse-overlayfs-1.13-1.module_el8+804+f 247 kB/s | 70 kB 00:00 2024-02-22T19:01:09.891 INFO:teuthology.orchestra.run.smithi062.stdout:(20/22): slirp4netns-1.2.3-1.module_el8+951+320 750 kB/s | 56 kB 00:00 2024-02-22T19:01:10.124 INFO:teuthology.orchestra.run.smithi062.stdout:(21/22): runc-1.1.12-1.module_el8+885+7da147f3. 8.6 MB/s | 3.1 MB 00:00 2024-02-22T19:01:10.420 INFO:teuthology.orchestra.run.smithi063.stdout:(10/22): udica-0.2.6-20.module_el8+804+f131391c 83 kB/s | 53 kB 00:00 2024-02-22T19:01:10.900 INFO:teuthology.orchestra.run.smithi062.stdout:(22/22): containernetworking-plugins-1.4.0-1.mo 11 MB/s | 22 MB 00:01 2024-02-22T19:01:10.900 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-22T19:01:10.900 INFO:teuthology.orchestra.run.smithi062.stdout:Total 10 MB/s | 54 MB 00:05 2024-02-22T19:01:10.987 INFO:teuthology.orchestra.run.smithi063.stdout:(11/22): yajl-2.1.0-12.el8.x86_64.rpm 72 kB/s | 41 kB 00:00 2024-02-22T19:01:11.417 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-02-22T19:01:11.466 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-02-22T19:01:11.467 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-02-22T19:01:11.470 INFO:teuthology.orchestra.run.smithi063.stdout:(12/22): skopeo-1.14.3-0.1.module_el8+885+7da14 3.6 MB/s | 8.8 MB 00:02 2024-02-22T19:01:11.504 INFO:teuthology.orchestra.run.smithi063.stdout:(13/22): conmon-2.1.10-1.module_el8+804+f131391 112 kB/s | 58 kB 00:00 2024-02-22T19:01:11.788 INFO:teuthology.orchestra.run.smithi063.stdout:(14/22): toolbox-0.0.99.5-1.module_el8+847+7863 1.2 MB/s | 2.5 MB 00:02 2024-02-22T19:01:12.037 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-02-22T19:01:12.041 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-02-22T19:01:12.142 INFO:teuthology.orchestra.run.smithi063.stdout:(15/22): container-selinux-2.229.0-2.module_el8 106 kB/s | 71 kB 00:00 2024-02-22T19:01:12.547 INFO:teuthology.orchestra.run.smithi063.stdout:(16/22): containers-common-1-80.module_el8+954+ 195 kB/s | 148 kB 00:00 2024-02-22T19:01:13.197 INFO:teuthology.orchestra.run.smithi063.stdout:(17/22): fuse-overlayfs-1.13-1.module_el8+804+f 108 kB/s | 70 kB 00:00 2024-02-22T19:01:13.451 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-02-22T19:01:13.453 INFO:teuthology.orchestra.run.smithi063.stdout:[MIRROR] libslirp-4.4.0-1.module_el8+804+f131391c.x86_64.rpm: Status code: 503 for http://mirrors.rcs.alaska.edu/centos/8-stream/AppStream/x86_64/os/Packages/libslirp-4.4.0-1.module_el8%2b804%2bf131391c.x86_64.rpm (IP: 199.165.82.202) 2024-02-22T19:01:13.464 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: container-selinux-2:2.229.0-2.module_el8+847+7863d4e 1/1 2024-02-22T19:01:13.500 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: container-selinux-2:2.229.0-2.module_el8+847+7863d 1/31 2024-02-22T19:01:13.542 INFO:teuthology.orchestra.run.smithi063.stdout:(18/22): criu-3.18-4.module_el8+804+f131391c.x8 403 kB/s | 564 kB 00:01 2024-02-22T19:01:13.698 INFO:teuthology.orchestra.run.smithi063.stdout:(19/22): libslirp-4.4.0-1.module_el8+804+f13139 141 kB/s | 70 kB 00:00 2024-02-22T19:01:13.750 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : container-selinux-2:2.229.0-2.module_el8+847+7863d 1/31 2024-02-22T19:01:13.941 INFO:teuthology.orchestra.run.smithi063.stdout:[MIRROR] slirp4netns-1.2.3-1.module_el8+951+32019cde.x86_64.rpm: Status code: 503 for http://mirrors.rcs.alaska.edu/centos/8-stream/AppStream/x86_64/os/Packages/slirp4netns-1.2.3-1.module_el8%2b951%2b32019cde.x86_64.rpm (IP: 199.165.82.202) 2024-02-22T19:01:14.015 INFO:teuthology.orchestra.run.smithi063.stdout:(20/22): slirp4netns-1.2.3-1.module_el8+951+320 177 kB/s | 56 kB 00:00 2024-02-22T19:01:14.956 INFO:teuthology.orchestra.run.smithi063.stdout:(21/22): containernetworking-plugins-1.4.0-1.mo 6.4 MB/s | 22 MB 00:03 2024-02-22T19:01:15.648 INFO:teuthology.orchestra.run.smithi063.stdout:(22/22): runc-1.1.12-1.module_el8+885+7da147f3. 1.5 MB/s | 3.1 MB 00:02 2024-02-22T19:01:15.649 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2024-02-22T19:01:15.649 INFO:teuthology.orchestra.run.smithi063.stdout:Total 5.4 MB/s | 54 MB 00:09 2024-02-22T19:01:16.163 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2024-02-22T19:01:16.212 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2024-02-22T19:01:16.212 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2024-02-22T19:01:16.730 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2024-02-22T19:01:16.733 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2024-02-22T19:01:18.142 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2024-02-22T19:01:18.155 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: container-selinux-2:2.229.0-2.module_el8+847+7863d4e 1/1 2024-02-22T19:01:18.192 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: container-selinux-2:2.229.0-2.module_el8+847+7863d 1/31 2024-02-22T19:01:18.431 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : container-selinux-2:2.229.0-2.module_el8+847+7863d 1/31 2024-02-22T19:01:32.608 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: container-selinux-2:2.229.0-2.module_el8+847+7863d 1/31 2024-02-22T19:01:33.179 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : criu-3.18-4.module_el8+804+f131391c.x86_64 2/31 2024-02-22T19:01:33.418 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : runc-1:1.1.12-1.module_el8+885+7da147f3.x86_64 3/31 2024-02-22T19:01:33.597 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : criu-libs-3.18-4.module_el8+804+f131391c.x86_64 4/31 2024-02-22T19:01:33.837 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : libslirp-4.4.0-1.module_el8+804+f131391c.x86_64 5/31 2024-02-22T19:01:34.079 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : slirp4netns-1.2.3-1.module_el8+951+32019cde.x86_64 6/31 2024-02-22T19:01:34.239 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_ 7/31 2024-02-22T19:01:36.217 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_ 7/31 2024-02-22T19:01:36.432 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : containernetworking-plugins-1:1.4.0-1.module_el8+8 8/31 2024-02-22T19:01:36.661 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : yajl-2.1.0-12.el8.x86_64 9/31 2024-02-22T19:01:37.019 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : crun-1.14.1-1.module_el8+951+32019cde.x86_64 10/31 2024-02-22T19:01:37.532 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: container-selinux-2:2.229.0-2.module_el8+847+7863d 1/31 2024-02-22T19:01:38.068 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : containers-common-2:1-80.module_el8+954+1d378e5e.x 11/31 2024-02-22T19:01:38.102 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : criu-3.18-4.module_el8+804+f131391c.x86_64 2/31 2024-02-22T19:01:38.303 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 12/31 2024-02-22T19:01:38.374 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : runc-1:1.1.12-1.module_el8+885+7da147f3.x86_64 3/31 2024-02-22T19:01:38.480 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 13/31 2024-02-22T19:01:38.564 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : criu-libs-3.18-4.module_el8+804+f131391c.x86_64 4/31 2024-02-22T19:01:38.739 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libslirp-4.4.0-1.module_el8+804+f131391c.x86_64 5/31 2024-02-22T19:01:38.806 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 14/31 2024-02-22T19:01:38.970 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : slirp4netns-1.2.3-1.module_el8+951+32019cde.x86_64 6/31 2024-02-22T19:01:39.179 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_ 7/31 2024-02-22T19:01:39.421 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 15/31 2024-02-22T19:01:40.500 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 16/31 2024-02-22T19:01:40.794 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 17/31 2024-02-22T19:01:41.194 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_ 7/31 2024-02-22T19:01:41.307 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 18/31 2024-02-22T19:01:41.419 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : containernetworking-plugins-1:1.4.0-1.module_el8+8 8/31 2024-02-22T19:01:41.504 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 19/31 2024-02-22T19:01:41.658 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : yajl-2.1.0-12.el8.x86_64 9/31 2024-02-22T19:01:41.729 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 20/31 2024-02-22T19:01:41.877 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : crun-1.14.1-1.module_el8+951+32019cde.x86_64 10/31 2024-02-22T19:01:42.130 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : conmon-3:2.1.10-1.module_el8+804+f131391c.x86_64 21/31 2024-02-22T19:01:42.332 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 22/31 2024-02-22T19:01:42.509 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : containers-common-2:1-49.module_el8.8.0+1254+78119 23/31 2024-02-22T19:01:42.698 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 24/31 2024-02-22T19:01:42.839 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 25/31 2024-02-22T19:01:42.840 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 26/31 2024-02-22T19:01:42.937 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : containers-common-2:1-80.module_el8+954+1d378e5e.x 11/31 2024-02-22T19:01:43.073 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 26/31 2024-02-22T19:01:43.126 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 12/31 2024-02-22T19:01:43.326 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 27/31 2024-02-22T19:01:43.337 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 13/31 2024-02-22T19:01:43.474 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 28/31 2024-02-22T19:01:43.661 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 14/31 2024-02-22T19:01:43.705 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : fuse-overlayfs-1.10-1.module_el8.8.0+1254+78119b6e 29/31 2024-02-22T19:01:43.947 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : containernetworking-plugins-1:1.1.1-3.module_el8.7 30/31 2024-02-22T19:01:44.180 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 31/31 2024-02-22T19:01:44.286 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 15/31 2024-02-22T19:01:45.334 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 16/31 2024-02-22T19:01:45.646 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 17/31 2024-02-22T19:01:46.156 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 18/31 2024-02-22T19:01:46.540 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 19/31 2024-02-22T19:01:46.763 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 20/31 2024-02-22T19:01:47.051 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : conmon-3:2.1.10-1.module_el8+804+f131391c.x86_64 21/31 2024-02-22T19:01:47.221 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 22/31 2024-02-22T19:01:47.445 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : containers-common-2:1-49.module_el8.8.0+1254+78119 23/31 2024-02-22T19:01:47.655 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 24/31 2024-02-22T19:01:47.821 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 25/31 2024-02-22T19:01:47.821 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 26/31 2024-02-22T19:01:48.047 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 26/31 2024-02-22T19:01:48.253 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 27/31 2024-02-22T19:01:48.401 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 28/31 2024-02-22T19:01:48.627 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : fuse-overlayfs-1.10-1.module_el8.8.0+1254+78119b6e 29/31 2024-02-22T19:01:48.854 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : containernetworking-plugins-1:1.1.1-3.module_el8.7 30/31 2024-02-22T19:01:49.061 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 31/31 2024-02-22T19:02:05.304 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: container-selinux-2:2.229.0-2.module_el8+847+7863d 31/31 2024-02-22T19:02:05.947 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 31/31 2024-02-22T19:02:05.947 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/31 2024-02-22T19:02:05.947 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2/31 2024-02-22T19:02:05.947 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 3/31 2024-02-22T19:02:05.947 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : criu-libs-3.18-4.module_el8+804+f131391c.x86_64 4/31 2024-02-22T19:02:05.947 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : crun-1.14.1-1.module_el8+951+32019cde.x86_64 5/31 2024-02-22T19:02:05.947 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 6/31 2024-02-22T19:02:05.947 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/31 2024-02-22T19:02:05.947 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/31 2024-02-22T19:02:05.947 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/31 2024-02-22T19:02:05.947 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/31 2024-02-22T19:02:05.947 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 11/31 2024-02-22T19:02:05.948 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/31 2024-02-22T19:02:05.948 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/31 2024-02-22T19:02:05.948 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : conmon-3:2.1.10-1.module_el8+804+f131391c.x86_64 14/31 2024-02-22T19:02:05.948 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 15/31 2024-02-22T19:02:05.948 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : container-selinux-2:2.229.0-2.module_el8+847+7863d 16/31 2024-02-22T19:02:05.948 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 17/31 2024-02-22T19:02:05.948 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : containernetworking-plugins-1:1.4.0-1.module_el8+8 18/31 2024-02-22T19:02:05.948 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : containernetworking-plugins-1:1.1.1-3.module_el8.7 19/31 2024-02-22T19:02:05.948 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : containers-common-2:1-80.module_el8+954+1d378e5e.x 20/31 2024-02-22T19:02:05.948 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : containers-common-2:1-49.module_el8.8.0+1254+78119 21/31 2024-02-22T19:02:05.948 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : criu-3.18-4.module_el8+804+f131391c.x86_64 22/31 2024-02-22T19:02:05.948 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 23/31 2024-02-22T19:02:05.948 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_ 24/31 2024-02-22T19:02:05.948 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : fuse-overlayfs-1.10-1.module_el8.8.0+1254+78119b6e 25/31 2024-02-22T19:02:05.949 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libslirp-4.4.0-1.module_el8+804+f131391c.x86_64 26/31 2024-02-22T19:02:05.949 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 27/31 2024-02-22T19:02:05.949 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : runc-1:1.1.12-1.module_el8+885+7da147f3.x86_64 28/31 2024-02-22T19:02:05.949 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 29/31 2024-02-22T19:02:05.949 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : slirp4netns-1.2.3-1.module_el8+951+32019cde.x86_64 30/31 2024-02-22T19:02:06.706 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 31/31 2024-02-22T19:02:06.706 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T19:02:06.706 INFO:teuthology.orchestra.run.smithi062.stdout:Upgraded: 2024-02-22T19:02:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: conmon-3:2.1.10-1.module_el8+804+f131391c.x86_64 2024-02-22T19:02:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: container-selinux-2:2.229.0-2.module_el8+847+7863d4e6.noarch 2024-02-22T19:02:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: containernetworking-plugins-1:1.4.0-1.module_el8+804+f131391c.x86_64 2024-02-22T19:02:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: containers-common-2:1-80.module_el8+954+1d378e5e.x86_64 2024-02-22T19:02:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: criu-3.18-4.module_el8+804+f131391c.x86_64 2024-02-22T19:02:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_64 2024-02-22T19:02:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: libslirp-4.4.0-1.module_el8+804+f131391c.x86_64 2024-02-22T19:02:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: runc-1:1.1.12-1.module_el8+885+7da147f3.x86_64 2024-02-22T19:02:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: slirp4netns-1.2.3-1.module_el8+951+32019cde.x86_64 2024-02-22T19:02:06.707 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-02-22T19:02:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-02-22T19:02:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2024-02-22T19:02:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 2024-02-22T19:02:06.707 INFO:teuthology.orchestra.run.smithi062.stdout: criu-libs-3.18-4.module_el8+804+f131391c.x86_64 2024-02-22T19:02:06.708 INFO:teuthology.orchestra.run.smithi062.stdout: crun-1.14.1-1.module_el8+951+32019cde.x86_64 2024-02-22T19:02:06.708 INFO:teuthology.orchestra.run.smithi062.stdout: netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 2024-02-22T19:02:06.708 INFO:teuthology.orchestra.run.smithi062.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-02-22T19:02:06.708 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-02-22T19:02:06.708 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-02-22T19:02:06.708 INFO:teuthology.orchestra.run.smithi062.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-02-22T19:02:06.708 INFO:teuthology.orchestra.run.smithi062.stdout: toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 2024-02-22T19:02:06.708 INFO:teuthology.orchestra.run.smithi062.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-02-22T19:02:06.708 INFO:teuthology.orchestra.run.smithi062.stdout: yajl-2.1.0-12.el8.x86_64 2024-02-22T19:02:06.708 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T19:02:06.708 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-02-22T19:02:07.020 DEBUG:teuthology.parallel:result is None 2024-02-22T19:02:10.496 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: container-selinux-2:2.229.0-2.module_el8+847+7863d 31/31 2024-02-22T19:02:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 31/31 2024-02-22T19:02:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/31 2024-02-22T19:02:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2/31 2024-02-22T19:02:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 3/31 2024-02-22T19:02:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : criu-libs-3.18-4.module_el8+804+f131391c.x86_64 4/31 2024-02-22T19:02:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : crun-1.14.1-1.module_el8+951+32019cde.x86_64 5/31 2024-02-22T19:02:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 6/31 2024-02-22T19:02:10.969 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/31 2024-02-22T19:02:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/31 2024-02-22T19:02:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/31 2024-02-22T19:02:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/31 2024-02-22T19:02:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 11/31 2024-02-22T19:02:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/31 2024-02-22T19:02:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/31 2024-02-22T19:02:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : conmon-3:2.1.10-1.module_el8+804+f131391c.x86_64 14/31 2024-02-22T19:02:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 15/31 2024-02-22T19:02:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : container-selinux-2:2.229.0-2.module_el8+847+7863d 16/31 2024-02-22T19:02:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 17/31 2024-02-22T19:02:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : containernetworking-plugins-1:1.4.0-1.module_el8+8 18/31 2024-02-22T19:02:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : containernetworking-plugins-1:1.1.1-3.module_el8.7 19/31 2024-02-22T19:02:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : containers-common-2:1-80.module_el8+954+1d378e5e.x 20/31 2024-02-22T19:02:10.970 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : containers-common-2:1-49.module_el8.8.0+1254+78119 21/31 2024-02-22T19:02:10.971 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : criu-3.18-4.module_el8+804+f131391c.x86_64 22/31 2024-02-22T19:02:10.971 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 23/31 2024-02-22T19:02:10.972 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_ 24/31 2024-02-22T19:02:10.972 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fuse-overlayfs-1.10-1.module_el8.8.0+1254+78119b6e 25/31 2024-02-22T19:02:10.972 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libslirp-4.4.0-1.module_el8+804+f131391c.x86_64 26/31 2024-02-22T19:02:10.972 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 27/31 2024-02-22T19:02:10.972 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : runc-1:1.1.12-1.module_el8+885+7da147f3.x86_64 28/31 2024-02-22T19:02:10.972 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 29/31 2024-02-22T19:02:10.972 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : slirp4netns-1.2.3-1.module_el8+951+32019cde.x86_64 30/31 2024-02-22T19:02:11.758 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 31/31 2024-02-22T19:02:11.758 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-02-22T19:02:11.758 INFO:teuthology.orchestra.run.smithi063.stdout:Upgraded: 2024-02-22T19:02:11.758 INFO:teuthology.orchestra.run.smithi063.stdout: conmon-3:2.1.10-1.module_el8+804+f131391c.x86_64 2024-02-22T19:02:11.759 INFO:teuthology.orchestra.run.smithi063.stdout: container-selinux-2:2.229.0-2.module_el8+847+7863d4e6.noarch 2024-02-22T19:02:11.759 INFO:teuthology.orchestra.run.smithi063.stdout: containernetworking-plugins-1:1.4.0-1.module_el8+804+f131391c.x86_64 2024-02-22T19:02:11.759 INFO:teuthology.orchestra.run.smithi063.stdout: containers-common-2:1-80.module_el8+954+1d378e5e.x86_64 2024-02-22T19:02:11.759 INFO:teuthology.orchestra.run.smithi063.stdout: criu-3.18-4.module_el8+804+f131391c.x86_64 2024-02-22T19:02:11.759 INFO:teuthology.orchestra.run.smithi063.stdout: fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_64 2024-02-22T19:02:11.759 INFO:teuthology.orchestra.run.smithi063.stdout: libslirp-4.4.0-1.module_el8+804+f131391c.x86_64 2024-02-22T19:02:11.759 INFO:teuthology.orchestra.run.smithi063.stdout: runc-1:1.1.12-1.module_el8+885+7da147f3.x86_64 2024-02-22T19:02:11.759 INFO:teuthology.orchestra.run.smithi063.stdout: slirp4netns-1.2.3-1.module_el8+951+32019cde.x86_64 2024-02-22T19:02:11.759 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2024-02-22T19:02:11.759 INFO:teuthology.orchestra.run.smithi063.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-02-22T19:02:11.759 INFO:teuthology.orchestra.run.smithi063.stdout: buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2024-02-22T19:02:11.759 INFO:teuthology.orchestra.run.smithi063.stdout: cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 2024-02-22T19:02:11.759 INFO:teuthology.orchestra.run.smithi063.stdout: criu-libs-3.18-4.module_el8+804+f131391c.x86_64 2024-02-22T19:02:11.759 INFO:teuthology.orchestra.run.smithi063.stdout: crun-1.14.1-1.module_el8+951+32019cde.x86_64 2024-02-22T19:02:11.759 INFO:teuthology.orchestra.run.smithi063.stdout: netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 2024-02-22T19:02:11.760 INFO:teuthology.orchestra.run.smithi063.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-02-22T19:02:11.760 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-02-22T19:02:11.760 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-02-22T19:02:11.760 INFO:teuthology.orchestra.run.smithi063.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-02-22T19:02:11.760 INFO:teuthology.orchestra.run.smithi063.stdout: toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 2024-02-22T19:02:11.760 INFO:teuthology.orchestra.run.smithi063.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-02-22T19:02:11.760 INFO:teuthology.orchestra.run.smithi063.stdout: yajl-2.1.0-12.el8.x86_64 2024-02-22T19:02:11.760 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-02-22T19:02:11.760 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2024-02-22T19:02:12.254 DEBUG:teuthology.parallel:result is None 2024-02-22T19:02:12.254 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-22T19:02:12.335 INFO:tasks.cephadm:Config: {'add_mons_via_daemon_add': True, 'allow_ptrace': False, 'avoid_pacific_features': True, 'cephadm_branch': 'v15.2.0', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'docker.io/ceph/ceph:v15.2.0', 'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MON_DOWN\\)', '\\(PG_', 'mons down', 'pg inactive', 'out of quorum', '\\(OSD_', 'osds down', 'osd down'], 'sha1': 'eb66ed921e744301e6863be6353618d63967ea59'} 2024-02-22T19:02:12.335 INFO:tasks.cephadm:Cluster image is docker.io/ceph/ceph:v15.2.0 2024-02-22T19:02:12.335 INFO:tasks.cephadm:Cluster fsid is e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:02:12.335 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-22T19:02:12.336 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.62', 'mon.c': '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]', 'mon.b': '172.21.15.63'} 2024-02-22T19:02:12.336 INFO:tasks.cephadm:First mon is mon.a on smithi062 2024-02-22T19:02:12.336 INFO:tasks.cephadm:First mgr is y 2024-02-22T19:02:12.336 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-22T19:02:12.336 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname $(hostname -s) 2024-02-22T19:02:12.372 DEBUG:teuthology.orchestra.run.smithi063:> sudo hostname $(hostname -s) 2024-02-22T19:02:12.401 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v15.2.0)... 2024-02-22T19:02:12.402 DEBUG:teuthology.orchestra.run.smithi062:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-22T19:02:12.670 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-rw-r--. 1 ubuntu ubuntu 151122 Feb 22 19:02 /home/ubuntu/cephtest/cephadm 2024-02-22T19:02:12.670 DEBUG:teuthology.orchestra.run.smithi063:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-22T19:02:12.934 INFO:teuthology.orchestra.run.smithi063.stdout:-rw-rw-r--. 1 ubuntu ubuntu 151122 Feb 22 19:02 /home/ubuntu/cephtest/cephadm 2024-02-22T19:02:12.935 DEBUG:teuthology.orchestra.run.smithi062:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-22T19:02:12.958 DEBUG:teuthology.orchestra.run.smithi063:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-22T19:02:12.993 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph 2024-02-22T19:02:13.032 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph 2024-02-22T19:02:13.066 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /etc/ceph 2024-02-22T19:02:13.104 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 777 /etc/ceph 2024-02-22T19:02:13.138 INFO:tasks.cephadm:Writing seed config... 2024-02-22T19:02:13.139 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2024-02-22T19:02:13.139 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-22T19:02:13.139 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-22T19:02:13.139 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-22T19:02:13.139 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-22T19:02:13.139 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-22T19:02:13.139 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-22T19:02:13.139 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-22T19:02:13.140 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-22T19:02:13.140 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-22T19:02:13.164 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = e2bc0d14-d1b4-11ee-95bf-87774f69a715 mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-02-22T19:02:13.164 DEBUG:teuthology.orchestra.run.smithi062:mon.a> sudo journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.a.service 2024-02-22T19:02:13.207 DEBUG:teuthology.orchestra.run.smithi062:mgr.y> sudo journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mgr.y.service 2024-02-22T19:02:13.236 INFO:journalctl@ceph.mon.a.smithi062.stdout:-- Logs begin at Thu 2024-02-22 18:41:31 UTC. -- 2024-02-22T19:02:13.236 INFO:tasks.cephadm:Bootstrapping... 2024-02-22T19:02:13.237 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 -v bootstrap --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.62 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-22T19:02:13.264 INFO:journalctl@ceph.mgr.y.smithi062.stdout:-- Logs begin at Thu 2024-02-22 18:41:31 UTC. -- 2024-02-22T19:02:13.388 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Verifying podman|docker is present... 2024-02-22T19:02:13.388 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Verifying lvm2 is present... 2024-02-22T19:02:13.388 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Verifying time synchronization is in place... 2024-02-22T19:02:13.388 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2024-02-22T19:02:13.394 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-22T19:02:13.394 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2024-02-22T19:02:13.399 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:systemctl:stdout inactive 2024-02-22T19:02:13.399 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2024-02-22T19:02:13.404 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:systemctl:stdout enabled 2024-02-22T19:02:13.404 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2024-02-22T19:02:13.409 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:systemctl:stdout active 2024-02-22T19:02:13.410 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Unit chronyd.service is enabled and running 2024-02-22T19:02:13.410 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Repeating the final host check... 2024-02-22T19:02:13.410 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:podman|docker (/bin/podman) is present 2024-02-22T19:02:13.410 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:systemctl is present 2024-02-22T19:02:13.410 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:lvcreate is present 2024-02-22T19:02:13.410 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2024-02-22T19:02:13.414 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-22T19:02:13.414 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2024-02-22T19:02:13.419 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:systemctl:stdout inactive 2024-02-22T19:02:13.419 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2024-02-22T19:02:13.424 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:systemctl:stdout enabled 2024-02-22T19:02:13.424 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2024-02-22T19:02:13.429 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:systemctl:stdout active 2024-02-22T19:02:13.429 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Unit chronyd.service is enabled and running 2024-02-22T19:02:13.429 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Host looks OK 2024-02-22T19:02:13.429 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:root:Cluster fsid: e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:02:13.429 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Acquiring lock 140113678342296 on /run/cephadm/e2bc0d14-d1b4-11ee-95bf-87774f69a715.lock 2024-02-22T19:02:13.429 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Lock 140113678342296 acquired on /run/cephadm/e2bc0d14-d1b4-11ee-95bf-87774f69a715.lock 2024-02-22T19:02:13.430 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Verifying IP 172.21.15.62 port 3300 ... 2024-02-22T19:02:13.430 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Verifying IP 172.21.15.62 port 6789 ... 2024-02-22T19:02:13.430 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Base mon IP is 172.21.15.62, final addrv is [v2:172.21.15.62:3300,v1:172.21.15.62:6789] 2024-02-22T19:02:13.430 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /sbin/ip route ls 2024-02-22T19:02:13.432 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/sbin/ip:stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.62 metric 100 2024-02-22T19:02:13.432 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/sbin/ip:stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.62 metric 100 2024-02-22T19:02:13.432 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Mon IP 172.21.15.62 is in CIDR network 172.21.0.0/20 2024-02-22T19:02:13.433 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Pulling latest docker.io/ceph/ceph:v15.2.0 container... 2024-02-22T19:02:13.433 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman pull docker.io/ceph/ceph:v15.2.0 2024-02-22T19:02:15.147 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/bin/podman:stderr Trying to pull docker.io/ceph/ceph:v15.2.0... 2024-02-22T19:02:22.040 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/bin/podman:stderr Getting image source signatures 2024-02-22T19:02:22.050 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:120f0bd0d532e2094e4c344cda2d32931787ee8c2e5d6b9ddd4698dfe3ef6110 2024-02-22T19:02:22.050 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:8a29a15cefaeccf6545f7ecf11298f9672d2f0cdaf9e357a95133ac3ad3e1f07 2024-02-22T19:02:35.355 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/bin/podman:stderr Copying config sha256:204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1 2024-02-22T19:02:35.538 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/bin/podman:stderr Writing manifest to image destination 2024-02-22T19:02:35.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/bin/podman:stdout 204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1 2024-02-22T19:02:35.779 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Extracting ceph user uid/gid from container image... 2024-02-22T19:02:35.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '--entrypoint', 'stat', 'docker.io/ceph/ceph:v15.2.0', '-c', '%u %g', '/var/lib/ceph'] 2024-02-22T19:02:35.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 --entrypoint stat docker.io/ceph/ceph:v15.2.0 -c %u %g /var/lib/ceph 2024-02-22T19:02:36.352 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:stat:stdout 167 167 2024-02-22T19:02:36.965 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Creating initial keys... 2024-02-22T19:02:36.965 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2024-02-22T19:02:36.965 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2024-02-22T19:02:37.508 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQBNmtdl34ZYFxAAHK5S0U5igW1lNhZwrHpdBg== 2024-02-22T19:02:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2024-02-22T19:02:38.113 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2024-02-22T19:02:38.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQBOmtdlhF4fIxAAnlNe6tkVPEZyxPw6nSjRYg== 2024-02-22T19:02:39.384 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2024-02-22T19:02:39.384 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2024-02-22T19:02:39.911 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQBPmtdl3xJpMBAAr5Ed2KEsNo51X+oKvBQBjw== 2024-02-22T19:02:40.500 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Creating initial monmap... 2024-02-22T19:02:40.501 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/tmp/ceph-tmpid8r4939:/tmp/monmap:z', '--entrypoint', '/usr/bin/monmaptool', 'docker.io/ceph/ceph:v15.2.0', '--create', '--clobber', '--fsid', 'e2bc0d14-d1b4-11ee-95bf-87774f69a715', '--addv', 'a', '[v2:172.21.15.62:3300,v1:172.21.15.62:6789]', '/tmp/monmap'] 2024-02-22T19:02:40.501 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /tmp/ceph-tmpid8r4939:/tmp/monmap:z --entrypoint /usr/bin/monmaptool docker.io/ceph/ceph:v15.2.0 --create --clobber --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 --addv a [v2:172.21.15.62:3300,v1:172.21.15.62:6789] /tmp/monmap 2024-02-22T19:02:41.118 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-22T19:02:41.118 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: set fsid to e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:02:41.118 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-22T19:02:41.703 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Creating mon... 2024-02-22T19:02:41.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z', '-v', '/var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z', '-v', '/tmp/ceph-tmpb3ef8j0v:/tmp/keyring:z', '-v', '/tmp/ceph-tmpid8r4939:/tmp/monmap:z', '--entrypoint', '/usr/bin/ceph-mon', 'docker.io/ceph/ceph:v15.2.0', '--mkfs', '-i', 'a', '--fsid', 'e2bc0d14-d1b4-11ee-95bf-87774f69a715', '-c', '/dev/null', '--monmap', '/tmp/monmap', '--keyring', '/tmp/keyring', '--setuser', 'ceph', '--setgroup', 'ceph', '--default-log-to-file=false', '--default-log-to-stderr=true', '--default-log-stderr-prefix="debug "', '--default-mon-cluster-log-to-file=false', '--default-mon-cluster-log-to-stderr=true'] 2024-02-22T19:02:41.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z -v /var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpb3ef8j0v:/tmp/keyring:z -v /tmp/ceph-tmpid8r4939:/tmp/monmap:z --entrypoint /usr/bin/ceph-mon docker.io/ceph/ceph:v15.2.0 --mkfs -i a --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix="debug " --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2024-02-22T19:02:42.331 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.199+0000 7f2e4ca2b6c0 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-22T19:02:42.332 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.200+0000 7f2e4ca2b6c0 1 imported monmap: 2024-02-22T19:02:42.332 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr epoch 0 2024-02-22T19:02:42.332 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:02:42.332 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr last_changed 2024-02-22T19:02:41.032114+0000 2024-02-22T19:02:42.332 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr created 2024-02-22T19:02:41.032114+0000 2024-02-22T19:02:42.332 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr min_mon_release 0 (unknown) 2024-02-22T19:02:42.332 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-02-22T19:02:42.332 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-22T19:02:42.332 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.200+0000 7f2e4ca2b6c0 0 /usr/bin/ceph-mon: set fsid to e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:02:42.332 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.200+0000 7f2e4ca2b6c0 0 set rocksdb option compression = kNoCompression 2024-02-22T19:02:42.332 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.200+0000 7f2e4ca2b6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-22T19:02:42.332 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.200+0000 7f2e4ca2b6c0 0 set rocksdb option write_buffer_size = 33554432 2024-02-22T19:02:42.332 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.200+0000 7f2e4ca2b6c0 0 set rocksdb option compression = kNoCompression 2024-02-22T19:02:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.200+0000 7f2e4ca2b6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-22T19:02:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.200+0000 7f2e4ca2b6c0 0 set rocksdb option write_buffer_size = 33554432 2024-02-22T19:02:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: RocksDB version: 6.1.2 2024-02-22T19:02:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-22T19:02:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-22T19:02:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Compile date Mar 23 2020 2024-02-22T19:02:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: DB SUMMARY 2024-02-22T19:02:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-22T19:02:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-02-22T19:02:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-22T19:02:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-02-22T19:02:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-22T19:02:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.error_if_exists: 0 2024-02-22T19:02:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.create_if_missing: 1 2024-02-22T19:02:42.333 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.paranoid_checks: 1 2024-02-22T19:02:42.334 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.env: 0x55648f7331a0 2024-02-22T19:02:42.334 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.info_log: 0x556490d71aa0 2024-02-22T19:02:42.334 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-22T19:02:42.334 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.statistics: (nil) 2024-02-22T19:02:42.334 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.use_fsync: 0 2024-02-22T19:02:42.334 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_log_file_size: 0 2024-02-22T19:02:42.334 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-22T19:02:42.334 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-22T19:02:42.334 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-22T19:02:42.334 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-22T19:02:42.334 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.allow_fallocate: 1 2024-02-22T19:02:42.334 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-22T19:02:42.334 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-22T19:02:42.334 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.use_direct_reads: 0 2024-02-22T19:02:42.334 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-22T19:02:42.335 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.create_missing_column_families: 0 2024-02-22T19:02:42.335 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.db_log_dir: 2024-02-22T19:02:42.335 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-02-22T19:02:42.335 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-22T19:02:42.335 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_subcompactions: 1 2024-02-22T19:02:42.335 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_background_flushes: -1 2024-02-22T19:02:42.335 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-22T19:02:42.335 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-22T19:02:42.335 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-22T19:02:42.335 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-22T19:02:42.335 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.advise_random_on_open: 1 2024-02-22T19:02:42.335 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-22T19:02:42.335 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.write_buffer_manager: 0x556491910120 2024-02-22T19:02:42.335 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-22T19:02:42.335 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-22T19:02:42.335 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-22T19:02:42.336 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-22T19:02:42.336 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.rate_limiter: (nil) 2024-02-22T19:02:42.336 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-22T19:02:42.336 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-22T19:02:42.336 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-22T19:02:42.336 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-22T19:02:42.336 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-22T19:02:42.336 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-22T19:02:42.337 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-22T19:02:42.337 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-22T19:02:42.337 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.row_cache: None 2024-02-22T19:02:42.337 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.wal_filter: None 2024-02-22T19:02:42.337 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-22T19:02:42.337 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-22T19:02:42.337 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.preserve_deletes: 0 2024-02-22T19:02:42.337 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.two_write_queues: 0 2024-02-22T19:02:42.337 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.manual_wal_flush: 0 2024-02-22T19:02:42.337 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.atomic_flush: 0 2024-02-22T19:02:42.337 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-22T19:02:42.337 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_background_jobs: 2 2024-02-22T19:02:42.337 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_background_compactions: -1 2024-02-22T19:02:42.337 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-22T19:02:42.337 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-22T19:02:42.338 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-22T19:02:42.338 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_total_wal_size: 0 2024-02-22T19:02:42.338 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-22T19:02:42.338 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-22T19:02:42.338 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-22T19:02:42.338 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-22T19:02:42.338 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_open_files: -1 2024-02-22T19:02:42.338 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.bytes_per_sync: 0 2024-02-22T19:02:42.338 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-22T19:02:42.338 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-22T19:02:42.338 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Compression algorithms supported: 2024-02-22T19:02:42.338 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-22T19:02:42.338 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: kZSTD supported: 0 2024-02-22T19:02:42.338 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: kXpressCompression supported: 0 2024-02-22T19:02:42.338 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-22T19:02:42.339 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: kLZ4Compression supported: 1 2024-02-22T19:02:42.339 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: kBZip2Compression supported: 0 2024-02-22T19:02:42.339 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: kZlibCompression supported: 1 2024-02-22T19:02:42.339 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: kSnappyCompression supported: 1 2024-02-22T19:02:42.339 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-22T19:02:42.339 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.201+0000 7f2e4ca2b6c0 4 rocksdb: [db/db_impl_open.cc:228] Creating manifest 1 2024-02-22T19:02:42.339 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-22T19:02:42.339 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-02-22T19:02:42.339 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-22T19:02:42.339 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2024-02-22T19:02:42.339 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-22T19:02:42.339 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-22T19:02:42.339 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.merge_operator: 2024-02-22T19:02:42.339 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.compaction_filter: None 2024-02-22T19:02:42.339 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.compaction_filter_factory: None 2024-02-22T19:02:42.340 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-22T19:02:42.340 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-22T19:02:42.340 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556490c96118) 2024-02-22T19:02:42.340 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks: 1 2024-02-22T19:02:42.340 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks_with_high_priority: 1 2024-02-22T19:02:42.340 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-22T19:02:42.340 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_top_level_index_and_filter: 1 2024-02-22T19:02:42.340 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_type: 0 2024-02-22T19:02:42.340 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_index_type: 0 2024-02-22T19:02:42.340 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_hash_table_util_ratio: 0.750000 2024-02-22T19:02:42.340 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr hash_index_allow_collision: 1 2024-02-22T19:02:42.340 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr checksum: 1 2024-02-22T19:02:42.340 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr no_block_cache: 0 2024-02-22T19:02:42.340 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache: 0x556490cd0510 2024-02-22T19:02:42.341 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_name: BinnedLRUCache 2024-02-22T19:02:42.341 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_options: 2024-02-22T19:02:42.341 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr capacity : 536870912 2024-02-22T19:02:42.341 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr num_shard_bits : 4 2024-02-22T19:02:42.341 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr strict_capacity_limit : 0 2024-02-22T19:02:42.341 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr high_pri_pool_ratio: 0.000 2024-02-22T19:02:42.341 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_compressed: (nil) 2024-02-22T19:02:42.342 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr persistent_cache: (nil) 2024-02-22T19:02:42.342 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size: 4096 2024-02-22T19:02:42.342 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size_deviation: 10 2024-02-22T19:02:42.342 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_restart_interval: 16 2024-02-22T19:02:42.342 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_block_restart_interval: 1 2024-02-22T19:02:42.342 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr metadata_block_size: 4096 2024-02-22T19:02:42.342 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr partition_filters: 0 2024-02-22T19:02:42.342 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr use_delta_encoding: 1 2024-02-22T19:02:42.342 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr filter_policy: rocksdb.BuiltinBloomFilter 2024-02-22T19:02:42.342 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr whole_key_filtering: 1 2024-02-22T19:02:42.342 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr verify_compression: 0 2024-02-22T19:02:42.342 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr read_amp_bytes_per_bit: 0 2024-02-22T19:02:42.342 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr format_version: 2 2024-02-22T19:02:42.342 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr enable_index_compression: 1 2024-02-22T19:02:42.342 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_align: 0 2024-02-22T19:02:42.343 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-22T19:02:42.343 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-22T19:02:42.343 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-22T19:02:42.343 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.compression: NoCompression 2024-02-22T19:02:42.343 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-22T19:02:42.343 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-22T19:02:42.343 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-22T19:02:42.343 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.num_levels: 7 2024-02-22T19:02:42.343 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-22T19:02:42.343 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-22T19:02:42.343 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-22T19:02:42.343 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-22T19:02:42.343 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-22T19:02:42.343 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-22T19:02:42.343 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-22T19:02:42.344 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-22T19:02:42.344 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-22T19:02:42.344 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.compression_opts.level: 32767 2024-02-22T19:02:42.344 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-22T19:02:42.344 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-22T19:02:42.344 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-22T19:02:42.344 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.compression_opts.enabled: false 2024-02-22T19:02:42.344 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-22T19:02:42.344 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-22T19:02:42.344 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-22T19:02:42.344 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-22T19:02:42.344 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-22T19:02:42.344 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-22T19:02:42.344 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-22T19:02:42.345 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-22T19:02:42.345 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-22T19:02:42.345 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-22T19:02:42.345 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-22T19:02:42.345 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-22T19:02:42.345 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-22T19:02:42.345 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-22T19:02:42.345 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-22T19:02:42.345 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-22T19:02:42.345 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-22T19:02:42.345 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.arena_block_size: 4194304 2024-02-22T19:02:42.345 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-22T19:02:42.345 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-22T19:02:42.345 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-22T19:02:42.345 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-22T19:02:42.346 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-22T19:02:42.346 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-22T19:02:42.346 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-22T19:02:42.346 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-22T19:02:42.346 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-22T19:02:42.346 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-22T19:02:42.346 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-22T19:02:42.346 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-22T19:02:42.346 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-22T19:02:42.346 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-22T19:02:42.346 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.table_properties_collectors: 2024-02-22T19:02:42.346 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.inplace_update_support: 0 2024-02-22T19:02:42.346 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-22T19:02:42.346 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-22T19:02:42.346 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-22T19:02:42.347 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-22T19:02:42.347 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.bloom_locality: 0 2024-02-22T19:02:42.347 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.max_successive_merges: 0 2024-02-22T19:02:42.347 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-22T19:02:42.347 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-22T19:02:42.347 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.force_consistency_checks: 0 2024-02-22T19:02:42.347 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-22T19:02:42.347 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: Options.ttl: 0 2024-02-22T19:02:42.347 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-22T19:02:42.347 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-22T19:02:42.347 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.202+0000 7f2e4ca2b6c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2024-02-22T19:02:42.347 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-22T19:02:42.347 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.205+0000 7f2e4ca2b6c0 4 rocksdb: DB pointer 0x556490d6c400 2024-02-22T19:02:42.347 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.205+0000 7f2e35bec700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2024-02-22T19:02:42.347 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.205+0000 7f2e35bec700 4 rocksdb: [db/db_impl.cc:778] 2024-02-22T19:02:42.348 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** DB Stats ** 2024-02-22T19:02:42.348 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T19:02:42.348 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-22T19:02:42.348 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-22T19:02:42.348 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T19:02:42.348 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-22T19:02:42.348 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-22T19:02:42.348 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T19:02:42.348 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-22T19:02:42.348 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2024-02-22T19:02:42.348 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T19:02:42.348 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T19:02:42.348 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T19:02:42.348 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T19:02:42.349 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-22T19:02:42.349 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2024-02-22T19:02:42.349 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T19:02:42.349 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T19:02:42.349 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T19:02:42.349 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2024-02-22T19:02:42.349 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T19:02:42.349 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2024-02-22T19:02:42.349 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T19:02:42.349 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2024-02-22T19:02:42.349 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T19:02:42.349 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T19:02:42.349 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T19:02:42.349 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-22T19:02:42.349 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2024-02-22T19:02:42.350 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-22T19:02:42.350 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2024-02-22T19:02:42.350 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T19:02:42.350 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T19:02:42.350 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T19:02:42.350 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T19:02:42.350 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-22T19:02:42.350 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2024-02-22T19:02:42.350 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T19:02:42.350 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T19:02:42.350 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T19:02:42.350 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2024-02-22T19:02:42.350 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T19:02:42.350 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2024-02-22T19:02:42.350 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T19:02:42.351 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2024-02-22T19:02:42.351 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T19:02:42.351 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T19:02:42.351 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T19:02:42.351 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-22T19:02:42.351 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2024-02-22T19:02:42.351 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-22T19:02:42.351 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.206+0000 7f2e4ca2b6c0 4 rocksdb: [db/db_impl.cc:390] Shutdown: canceling all background work 2024-02-22T19:02:42.351 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.207+0000 7f2e4ca2b6c0 4 rocksdb: [db/db_impl.cc:563] Shutdown complete 2024-02-22T19:02:42.351 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-22T19:02:42.207+0000 7f2e4ca2b6c0 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-02-22T19:02:42.869 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:02:42.874 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl disable ceph.target 2024-02-22T19:02:42.970 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl enable ceph.target 2024-02-22T19:02:42.978 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-22T19:02:43.064 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl start ceph.target 2024-02-22T19:02:43.071 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715.target 2024-02-22T19:02:43.077 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715.target → /etc/systemd/system/ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715.target. 2024-02-22T19:02:43.077 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715.target → /etc/systemd/system/ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715.target. 2024-02-22T19:02:43.158 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl start ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715.target 2024-02-22T19:02:43.170 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2024-02-22T19:02:43.259 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.a 2024-02-22T19:02:43.286 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.a 2024-02-22T19:02:43.291 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.a.service: Unit ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.a.service not loaded. 2024-02-22T19:02:43.291 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.a 2024-02-22T19:02:43.296 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715.target.wants/ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.a.service → /etc/systemd/system/ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@.service. 2024-02-22T19:02:43.377 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl start ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.a 2024-02-22T19:02:43.428 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl is-enabled firewalld.service 2024-02-22T19:02:43.435 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:systemctl:stdout disabled 2024-02-22T19:02:43.435 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl is-active firewalld.service 2024-02-22T19:02:43.443 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:systemctl:stdout inactive 2024-02-22T19:02:43.443 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:firewalld.service is not enabled 2024-02-22T19:02:43.443 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Waiting for mon to start... 2024-02-22T19:02:43.444 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Waiting for mon... 2024-02-22T19:02:43.444 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status 2024-02-22T19:02:43.651 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:43 smithi062 podman[63690]: Error: no container with ID or name "ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon.a" found: no such container 2024-02-22T19:02:43.652 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:43 smithi062 systemd[1]: Started Ceph mon.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:02:44.095 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:43 smithi062 bash[63708]: cluster 2024-02-22T19:02:43.816063+0000 mon.a (mon.0) 0 : [INF] mkfs e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:02:44.095 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:43 smithi062 bash[63708]: cluster 2024-02-22T19:02:43.789403+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-02-22T19:02:44.461 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout cluster: 2024-02-22T19:02:44.461 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout id: e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:02:44.461 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout health: HEALTH_OK 2024-02-22T19:02:44.461 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-22T19:02:44.461 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout services: 2024-02-22T19:02:44.461 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon: 1 daemons, quorum a (age 0.645341s) 2024-02-22T19:02:44.461 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr: no daemons active 2024-02-22T19:02:44.461 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd: 0 osds: 0 up, 0 in 2024-02-22T19:02:44.461 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-22T19:02:44.461 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout data: 2024-02-22T19:02:44.461 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pools: 0 pools, 0 pgs 2024-02-22T19:02:44.461 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout objects: 0 objects, 0 B 2024-02-22T19:02:44.462 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout usage: 0 B used, 0 B / 0 B avail 2024-02-22T19:02:44.462 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pgs: 2024-02-22T19:02:44.462 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-22T19:02:45.123 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Assimilating anything we can from ceph.conf... 2024-02-22T19:02:45.124 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'assimilate-conf', '-i', '/var/lib/ceph/mon/ceph-a/config'] 2024-02-22T19:02:45.124 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z -v /var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2024-02-22T19:02:45.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:44 smithi062 bash[63708]: cluster 2024-02-22T19:02:43.813155+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-02-22T19:02:45.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:44 smithi062 bash[63708]: cluster 2024-02-22T19:02:43.813320+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0]} 2024-02-22T19:02:45.127 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:44 smithi062 bash[63708]: cluster 2024-02-22T19:02:43.821750+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-02-22T19:02:45.127 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:44 smithi062 bash[63708]: cluster 2024-02-22T19:02:43.832478+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-22T19:02:45.127 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:44 smithi062 bash[63708]: cluster 2024-02-22T19:02:43.834584+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2024-02-22T19:02:45.127 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:44 smithi062 bash[63708]: audit 2024-02-22T19:02:44.458461+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.62:0/1143335560' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-22T19:02:45.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-22T19:02:45.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [global] 2024-02-22T19:02:45.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout fsid = e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:02:45.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout log_to_journald = false 2024-02-22T19:02:45.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_election_default_strategy = 1 2024-02-22T19:02:45.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_host = [v2:172.21.15.62:3300,v1:172.21.15.62:6789] 2024-02-22T19:02:45.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_pg_remap = true 2024-02-22T19:02:45.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_primary_affinity = true 2024-02-22T19:02:45.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_no_sortbitwise = false 2024-02-22T19:02:45.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_crush_chooseleaf_type = 0 2024-02-22T19:02:45.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-22T19:02:45.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [mgr] 2024-02-22T19:02:45.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr/telemetry/nag = false 2024-02-22T19:02:45.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-22T19:02:45.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [mon] 2024-02-22T19:02:45.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_insecure_global_id_reclaim = false 2024-02-22T19:02:45.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-22T19:02:45.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-22T19:02:45.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [osd] 2024-02-22T19:02:45.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_map_max_advance = 10 2024-02-22T19:02:45.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_memory_target_autotune = true 2024-02-22T19:02:45.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_sloppy_crc = true 2024-02-22T19:02:45.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:45 smithi062 bash[63708]: audit 2024-02-22T19:02:45.689705+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.62:0/860445311' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-22T19:02:45.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:45 smithi062 bash[63708]: audit 2024-02-22T19:02:45.692160+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.62:0/860445311' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-22T19:02:46.472 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Generating new minimal ceph.conf... 2024-02-22T19:02:46.472 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'generate-minimal-conf', '-o', '/var/lib/ceph/mon/ceph-a/config'] 2024-02-22T19:02:46.472 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z -v /var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2024-02-22T19:02:47.366 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:47 smithi062 bash[63708]: audit 2024-02-22T19:02:47.027321+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.62:0/2451227613' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:02:47.695 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Restarting the monitor... 2024-02-22T19:02:47.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl restart ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.a 2024-02-22T19:02:47.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:47 smithi062 systemd[1]: Stopping Ceph mon.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:02:47.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:47 smithi062 bash[63708]: debug 2024-02-22T19:02:47.821+0000 7f023b5ed700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:02:47.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:47 smithi062 bash[63708]: debug 2024-02-22T19:02:47.821+0000 7f023b5ed700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-02-22T19:02:48.696 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:48 smithi062 podman[64041]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon.a 2024-02-22T19:02:48.763 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Setting mon public_network... 2024-02-22T19:02:48.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'set', 'mon', 'public_network', '172.21.0.0/20'] 2024-02-22T19:02:48.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config set mon public_network 172.21.0.0/20 2024-02-22T19:02:48.958 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:48 smithi062 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.a.service: Succeeded. 2024-02-22T19:02:48.958 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:48 smithi062 systemd[1]: Stopped Ceph mon.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:02:48.958 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:48 smithi062 systemd[1]: Starting Ceph mon.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:02:48.958 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:48 smithi062 podman[64083]: Error: no container with ID or name "ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon.a" found: no such container 2024-02-22T19:02:48.958 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:48 smithi062 systemd[1]: Started Ceph mon.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:02:49.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.574+0000 7fce62a146c0 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-22T19:02:49.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.574+0000 7fce62a146c0 0 ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc), process ceph-mon, pid 1 2024-02-22T19:02:49.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.574+0000 7fce62a146c0 0 pidfile_write: ignore empty --pid-file 2024-02-22T19:02:49.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 0 load: jerasure load: lrc load: isa 2024-02-22T19:02:49.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 0 set rocksdb option compression = kNoCompression 2024-02-22T19:02:49.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-22T19:02:49.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 0 set rocksdb option write_buffer_size = 33554432 2024-02-22T19:02:49.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 0 set rocksdb option compression = kNoCompression 2024-02-22T19:02:49.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-22T19:02:49.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 0 set rocksdb option write_buffer_size = 33554432 2024-02-22T19:02:49.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 1 rocksdb: do_open column families: [default] 2024-02-22T19:02:49.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: RocksDB version: 6.1.2 2024-02-22T19:02:49.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-22T19:02:49.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Compile date Mar 23 2020 2024-02-22T19:02:49.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: DB SUMMARY 2024-02-22T19:02:49.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: CURRENT file: CURRENT 2024-02-22T19:02:49.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: IDENTITY file: IDENTITY 2024-02-22T19:02:49.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 109 Bytes 2024-02-22T19:02:49.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2024-02-22T19:02:49.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 69403 ; 2024-02-22T19:02:49.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.error_if_exists: 0 2024-02-22T19:02:49.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.create_if_missing: 0 2024-02-22T19:02:49.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.paranoid_checks: 1 2024-02-22T19:02:49.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.env: 0x559e82c3d1a0 2024-02-22T19:02:49.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.info_log: 0x559e84a849c0 2024-02-22T19:02:49.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-22T19:02:49.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.statistics: (nil) 2024-02-22T19:02:49.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.use_fsync: 0 2024-02-22T19:02:49.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.max_log_file_size: 0 2024-02-22T19:02:49.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-22T19:02:49.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-22T19:02:49.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-22T19:02:49.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-22T19:02:49.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.allow_fallocate: 1 2024-02-22T19:02:49.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-22T19:02:49.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-22T19:02:49.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.use_direct_reads: 0 2024-02-22T19:02:49.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-22T19:02:49.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.create_missing_column_families: 0 2024-02-22T19:02:49.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.db_log_dir: 2024-02-22T19:02:49.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-02-22T19:02:49.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-22T19:02:49.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.max_subcompactions: 1 2024-02-22T19:02:49.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.max_background_flushes: -1 2024-02-22T19:02:49.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-22T19:02:49.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-22T19:02:49.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-22T19:02:49.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-22T19:02:49.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.advise_random_on_open: 1 2024-02-22T19:02:49.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-22T19:02:49.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.write_buffer_manager: 0x559e8561cae0 2024-02-22T19:02:49.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-22T19:02:49.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-22T19:02:49.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-22T19:02:49.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-22T19:02:49.992 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.rate_limiter: (nil) 2024-02-22T19:02:49.992 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-22T19:02:49.992 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-22T19:02:49.992 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-22T19:02:49.992 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-22T19:02:49.992 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-22T19:02:49.992 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-22T19:02:49.993 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-22T19:02:49.993 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-22T19:02:49.993 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.row_cache: None 2024-02-22T19:02:49.993 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.wal_filter: None 2024-02-22T19:02:49.993 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-22T19:02:49.993 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-22T19:02:49.993 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.preserve_deletes: 0 2024-02-22T19:02:49.993 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.two_write_queues: 0 2024-02-22T19:02:49.993 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.manual_wal_flush: 0 2024-02-22T19:02:49.993 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.atomic_flush: 0 2024-02-22T19:02:49.993 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-22T19:02:49.993 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.max_background_jobs: 2 2024-02-22T19:02:49.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.max_background_compactions: -1 2024-02-22T19:02:49.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-22T19:02:49.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-22T19:02:49.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-22T19:02:49.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.max_total_wal_size: 0 2024-02-22T19:02:49.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-22T19:02:49.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-22T19:02:49.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-22T19:02:49.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-22T19:02:49.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.max_open_files: -1 2024-02-22T19:02:49.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.bytes_per_sync: 0 2024-02-22T19:02:49.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-22T19:02:49.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-22T19:02:49.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Compression algorithms supported: 2024-02-22T19:02:49.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-22T19:02:49.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: kZSTD supported: 0 2024-02-22T19:02:49.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: kXpressCompression supported: 0 2024-02-22T19:02:49.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-22T19:02:49.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: kLZ4Compression supported: 1 2024-02-22T19:02:49.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: kBZip2Compression supported: 0 2024-02-22T19:02:49.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: kZlibCompression supported: 1 2024-02-22T19:02:49.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: kSnappyCompression supported: 1 2024-02-22T19:02:49.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-22T19:02:49.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2024-02-22T19:02:49.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2024-02-22T19:02:49.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-22T19:02:49.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.merge_operator: 2024-02-22T19:02:49.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.compaction_filter: None 2024-02-22T19:02:49.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.compaction_filter_factory: None 2024-02-22T19:02:49.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-22T19:02:49.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-22T19:02:49.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559e849a0130) 2024-02-22T19:02:49.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: cache_index_and_filter_blocks: 1 2024-02-22T19:02:49.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: cache_index_and_filter_blocks_with_high_priority: 1 2024-02-22T19:02:49.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-22T19:02:49.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: pin_top_level_index_and_filter: 1 2024-02-22T19:02:49.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: index_type: 0 2024-02-22T19:02:49.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: data_block_index_type: 0 2024-02-22T19:02:49.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: data_block_hash_table_util_ratio: 0.750000 2024-02-22T19:02:49.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: hash_index_allow_collision: 1 2024-02-22T19:02:49.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: checksum: 1 2024-02-22T19:02:49.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: no_block_cache: 0 2024-02-22T19:02:49.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: block_cache: 0x559e849da610 2024-02-22T19:02:49.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: block_cache_name: BinnedLRUCache 2024-02-22T19:02:49.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: block_cache_options: 2024-02-22T19:02:49.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: capacity : 536870912 2024-02-22T19:02:49.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: num_shard_bits : 4 2024-02-22T19:02:49.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: strict_capacity_limit : 0 2024-02-22T19:02:49.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: high_pri_pool_ratio: 0.000 2024-02-22T19:02:49.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: block_cache_compressed: (nil) 2024-02-22T19:02:49.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: persistent_cache: (nil) 2024-02-22T19:02:49.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: block_size: 4096 2024-02-22T19:02:49.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: block_size_deviation: 10 2024-02-22T19:02:49.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: block_restart_interval: 16 2024-02-22T19:02:49.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: index_block_restart_interval: 1 2024-02-22T19:02:49.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: metadata_block_size: 4096 2024-02-22T19:02:49.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: partition_filters: 0 2024-02-22T19:02:49.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: use_delta_encoding: 1 2024-02-22T19:02:49.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-22T19:02:49.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: whole_key_filtering: 1 2024-02-22T19:02:49.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: verify_compression: 0 2024-02-22T19:02:49.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: read_amp_bytes_per_bit: 0 2024-02-22T19:02:49.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: format_version: 2 2024-02-22T19:02:49.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: enable_index_compression: 1 2024-02-22T19:02:49.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: block_align: 0 2024-02-22T19:02:49.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-22T19:02:49.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-22T19:02:49.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.compression: NoCompression 2024-02-22T19:02:49.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-22T19:02:49.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-22T19:02:49.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-22T19:02:49.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.num_levels: 7 2024-02-22T19:02:49.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-22T19:02:49.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-22T19:02:49.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.579+0000 7fce62a146c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-22T19:02:49.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-22T19:02:49.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-22T19:02:49.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-22T19:02:49.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-22T19:02:49.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-22T19:02:49.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-22T19:02:49.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.compression_opts.level: 32767 2024-02-22T19:02:49.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-22T19:02:49.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-22T19:02:49.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-22T19:02:49.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.compression_opts.enabled: false 2024-02-22T19:02:49.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-22T19:02:49.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-22T19:02:49.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-22T19:02:50.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-22T19:02:50.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-22T19:02:50.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-22T19:02:50.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-22T19:02:50.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-22T19:02:50.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-22T19:02:50.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-22T19:02:50.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-22T19:02:50.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-22T19:02:50.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-22T19:02:50.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-22T19:02:50.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-22T19:02:50.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-22T19:02:50.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-22T19:02:50.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.arena_block_size: 4194304 2024-02-22T19:02:50.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-22T19:02:50.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-22T19:02:50.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-22T19:02:50.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-22T19:02:50.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-22T19:02:50.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-22T19:02:50.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-22T19:02:50.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-22T19:02:50.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-22T19:02:50.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-22T19:02:50.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-22T19:02:50.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-22T19:02:50.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-22T19:02:50.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-22T19:02:50.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.table_properties_collectors: 2024-02-22T19:02:50.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.inplace_update_support: 0 2024-02-22T19:02:50.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-22T19:02:50.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-22T19:02:50.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-22T19:02:50.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-22T19:02:50.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.bloom_locality: 0 2024-02-22T19:02:50.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.max_successive_merges: 0 2024-02-22T19:02:50.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-22T19:02:50.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-22T19:02:50.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.force_consistency_checks: 0 2024-02-22T19:02:50.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-22T19:02:50.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: Options.ttl: 0 2024-02-22T19:02:50.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-22T19:02:50.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 4 2024-02-22T19:02:50.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708628569582212, "job": 1, "event": "recovery_started", "log_files": [6]} 2024-02-22T19:02:50.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.580+0000 7fce62a146c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #6 mode 2 2024-02-22T19:02:50.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.581+0000 7fce62a146c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708628569583055, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 66444, "table_properties": {"data_size": 64739, "index_size": 310, "filter_size": 581, "raw_key_size": 8761, "raw_average_key_size": 46, "raw_value_size": 59698, "raw_average_value_size": 319, "num_data_blocks": 10, "num_entries": 187, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2024-02-22T19:02:50.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.581+0000 7fce62a146c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 8 2024-02-22T19:02:50.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.581+0000 7fce62a146c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708628569583402, "job": 1, "event": "recovery_finished"} 2024-02-22T19:02:50.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.582+0000 7fce62a146c0 4 rocksdb: DB pointer 0x559e84a75200 2024-02-22T19:02:50.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.582+0000 7fce49b61700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2024-02-22T19:02:50.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.582+0000 7fce49b61700 4 rocksdb: [db/db_impl.cc:778] 2024-02-22T19:02:50.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: ** DB Stats ** 2024-02-22T19:02:50.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T19:02:50.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-22T19:02:50.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-22T19:02:50.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T19:02:50.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-22T19:02:50.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-22T19:02:50.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T19:02:50.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: ** Compaction Stats [default] ** 2024-02-22T19:02:50.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T19:02:50.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T19:02:50.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: L0 2/0 66.51 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 115.6 0.00 0.00 1 0.001 0 0 2024-02-22T19:02:50.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Sum 2/0 66.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 115.6 0.00 0.00 1 0.001 0 0 2024-02-22T19:02:50.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 115.6 0.00 0.00 1 0.001 0 0 2024-02-22T19:02:50.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: ** Compaction Stats [default] ** 2024-02-22T19:02:50.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T19:02:50.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T19:02:50.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 115.6 0.00 0.00 1 0.001 0 0 2024-02-22T19:02:50.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T19:02:50.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-22T19:02:50.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T19:02:50.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T19:02:50.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T19:02:50.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: AddFile(Keys): cumulative 0, interval 0 2024-02-22T19:02:50.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Cumulative compaction: 0.00 GB write, 22.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T19:02:50.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Interval compaction: 0.00 GB write, 22.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T19:02:50.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T19:02:50.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: ** File Read Latency Histogram By Level [default] ** 2024-02-22T19:02:50.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: ** Compaction Stats [default] ** 2024-02-22T19:02:50.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T19:02:50.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T19:02:50.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: L0 2/0 66.51 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 115.6 0.00 0.00 1 0.001 0 0 2024-02-22T19:02:50.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Sum 2/0 66.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 115.6 0.00 0.00 1 0.001 0 0 2024-02-22T19:02:50.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T19:02:50.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: ** Compaction Stats [default] ** 2024-02-22T19:02:50.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T19:02:50.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T19:02:50.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 115.6 0.00 0.00 1 0.001 0 0 2024-02-22T19:02:50.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T19:02:50.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-22T19:02:50.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T19:02:50.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T19:02:50.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T19:02:50.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: AddFile(Keys): cumulative 0, interval 0 2024-02-22T19:02:50.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Cumulative compaction: 0.00 GB write, 22.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T19:02:50.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T19:02:50.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T19:02:50.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: ** File Read Latency Histogram By Level [default] ** 2024-02-22T19:02:50.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.583+0000 7fce62a146c0 0 starting mon.a rank 0 at public addrs [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] at bind addrs [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:02:50.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.584+0000 7fce62a146c0 1 mon.a@-1(???) e1 preinit fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:02:50.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.584+0000 7fce62a146c0 0 mon.a@-1(???).mds e1 new map 2024-02-22T19:02:50.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.584+0000 7fce62a146c0 0 mon.a@-1(???).mds e1 print_map 2024-02-22T19:02:50.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: e1 2024-02-22T19:02:50.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: enable_multiple, ever_enabled_multiple: 0,0 2024-02-22T19:02:50.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T19:02:50.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: legacy client fscid: -1 2024-02-22T19:02:50.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: 2024-02-22T19:02:50.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: No filesystems configured 2024-02-22T19:02:50.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.584+0000 7fce62a146c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-22T19:02:50.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.584+0000 7fce62a146c0 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-22T19:02:50.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.584+0000 7fce62a146c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-22T19:02:50.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: audit 2024-02-22T19:02:47.027321+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.62:0/2451227613' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:02:50.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.584+0000 7fce62a146c0 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-22T19:02:50.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.585+0000 7fce62a146c0 20 expand_channel_meta expand map: {default=false} 2024-02-22T19:02:50.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.585+0000 7fce62a146c0 20 expand_channel_meta from 'false' to 'false' 2024-02-22T19:02:50.009 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.585+0000 7fce62a146c0 20 expand_channel_meta expanded map: {default=false} 2024-02-22T19:02:50.009 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.585+0000 7fce62a146c0 20 expand_channel_meta expand map: {default=info} 2024-02-22T19:02:50.009 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.585+0000 7fce62a146c0 20 expand_channel_meta from 'info' to 'info' 2024-02-22T19:02:50.009 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.585+0000 7fce62a146c0 20 expand_channel_meta expanded map: {default=info} 2024-02-22T19:02:50.009 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.585+0000 7fce62a146c0 20 expand_channel_meta expand map: {default=daemon} 2024-02-22T19:02:50.009 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.585+0000 7fce62a146c0 20 expand_channel_meta from 'daemon' to 'daemon' 2024-02-22T19:02:50.009 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.585+0000 7fce62a146c0 20 expand_channel_meta expanded map: {default=daemon} 2024-02-22T19:02:50.009 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.585+0000 7fce62a146c0 20 expand_channel_meta expand map: {default=debug} 2024-02-22T19:02:50.009 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.585+0000 7fce62a146c0 20 expand_channel_meta from 'debug' to 'debug' 2024-02-22T19:02:50.009 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: debug 2024-02-22T19:02:49.585+0000 7fce62a146c0 20 expand_channel_meta expanded map: {default=debug} 2024-02-22T19:02:50.009 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: cluster 2024-02-22T19:02:49.601250+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-02-22T19:02:50.009 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: cluster 2024-02-22T19:02:49.601289+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0]} 2024-02-22T19:02:50.009 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: cluster 2024-02-22T19:02:49.601322+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2024-02-22T19:02:50.009 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: cluster 2024-02-22T19:02:49.601346+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-22T19:02:50.009 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:49 smithi062 bash[64101]: cluster 2024-02-22T19:02:49.601667+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2024-02-22T19:02:50.449 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Creating mgr... 2024-02-22T19:02:50.450 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2024-02-22T19:02:50.549 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mgr.y 2024-02-22T19:02:50.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mgr.y 2024-02-22T19:02:50.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mgr.y.service: Unit ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mgr.y.service not loaded. 2024-02-22T19:02:50.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mgr.y 2024-02-22T19:02:50.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715.target.wants/ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mgr.y.service → /etc/systemd/system/ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@.service. 2024-02-22T19:02:50.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl start ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mgr.y 2024-02-22T19:02:50.704 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:50 smithi062 bash[64101]: audit 2024-02-22T19:02:49.752385+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.15.62:0/3528944605' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]: dispatch 2024-02-22T19:02:50.705 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:50 smithi062 bash[64101]: audit 2024-02-22T19:02:49.755180+0000 mon.a (mon.0) 7 : audit [INF] from='client.? 172.21.15.62:0/3528944605' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]': finished 2024-02-22T19:02:50.705 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:02:50 smithi062 systemd[1]: Starting Ceph mgr.y for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:02:50.705 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:02:50 smithi062 podman[64318]: Error: no container with ID or name "ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr.y" found: no such container 2024-02-22T19:02:50.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl is-enabled firewalld.service 2024-02-22T19:02:50.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:systemctl:stdout disabled 2024-02-22T19:02:50.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: systemctl is-active firewalld.service 2024-02-22T19:02:50.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:systemctl:stdout inactive 2024-02-22T19:02:50.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:firewalld.service is not enabled 2024-02-22T19:02:50.724 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-22T19:02:50.724 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Wrote config to /etc/ceph/ceph.conf 2024-02-22T19:02:50.724 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Waiting for mgr to start... 2024-02-22T19:02:50.724 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Waiting for mgr... 2024-02-22T19:02:50.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2024-02-22T19:02:50.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2024-02-22T19:02:50.984 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:02:50 smithi062 systemd[1]: Started Ceph mgr.y for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:02:52.054 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-22T19:02:52.054 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:02:52.054 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "e2bc0d14-d1b4-11ee-95bf-87774f69a715", 2024-02-22T19:02:52.055 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2024-02-22T19:02:52.055 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2024-02-22T19:02:52.055 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2024-02-22T19:02:52.055 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2024-02-22T19:02:52.055 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:52.055 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2024-02-22T19:02:52.055 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2024-02-22T19:02:52.055 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2024-02-22T19:02:52.055 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:02:52.055 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2024-02-22T19:02:52.055 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2024-02-22T19:02:52.055 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:02:52.055 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 2, 2024-02-22T19:02:52.055 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2024-02-22T19:02:52.056 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-22T19:02:52.056 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2024-02-22T19:02:52.056 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2024-02-22T19:02:52.056 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:52.056 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2024-02-22T19:02:52.056 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-22T19:02:52.056 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2024-02-22T19:02:52.056 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2024-02-22T19:02:52.056 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2024-02-22T19:02:52.056 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2024-02-22T19:02:52.056 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2024-02-22T19:02:52.056 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2024-02-22T19:02:52.056 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:52.056 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2024-02-22T19:02:52.056 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2024-02-22T19:02:52.057 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2024-02-22T19:02:52.057 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2024-02-22T19:02:52.057 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2024-02-22T19:02:52.057 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2024-02-22T19:02:52.057 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2024-02-22T19:02:52.057 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2024-02-22T19:02:52.057 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2024-02-22T19:02:52.057 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:52.057 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2024-02-22T19:02:52.057 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-22T19:02:52.057 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2024-02-22T19:02:52.057 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2024-02-22T19:02:52.057 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:52.057 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2024-02-22T19:02:52.057 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2024-02-22T19:02:52.058 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2024-02-22T19:02:52.058 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2024-02-22T19:02:52.058 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2024-02-22T19:02:52.058 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2024-02-22T19:02:52.058 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:02:52.058 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-02-22T19:02:52.058 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:52.058 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2024-02-22T19:02:52.058 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-22T19:02:52.058 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2024-02-22T19:02:43.816408+0000", 2024-02-22T19:02:52.058 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-02-22T19:02:52.058 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:52.058 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2024-02-22T19:02:52.058 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:02:52.339 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:52 smithi062 bash[64101]: audit 2024-02-22T19:02:52.047761+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.15.62:0/3858180351' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-22T19:02:52.617 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:mgr not available, waiting (1/10)... 2024-02-22T19:02:53.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2024-02-22T19:02:53.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2024-02-22T19:02:54.272 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-22T19:02:54.272 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:02:54.272 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "e2bc0d14-d1b4-11ee-95bf-87774f69a715", 2024-02-22T19:02:54.272 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2024-02-22T19:02:54.272 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2024-02-22T19:02:54.272 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2024-02-22T19:02:54.272 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2024-02-22T19:02:54.273 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:54.273 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2024-02-22T19:02:54.273 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2024-02-22T19:02:54.273 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2024-02-22T19:02:54.273 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:02:54.273 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2024-02-22T19:02:54.273 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2024-02-22T19:02:54.273 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:02:54.273 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 4, 2024-02-22T19:02:54.273 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2024-02-22T19:02:54.273 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-22T19:02:54.273 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2024-02-22T19:02:54.273 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2024-02-22T19:02:54.273 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:54.273 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2024-02-22T19:02:54.273 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-22T19:02:54.274 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2024-02-22T19:02:54.274 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2024-02-22T19:02:54.274 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2024-02-22T19:02:54.274 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2024-02-22T19:02:54.274 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2024-02-22T19:02:54.274 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2024-02-22T19:02:54.274 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:54.274 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2024-02-22T19:02:54.274 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2024-02-22T19:02:54.274 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2024-02-22T19:02:54.274 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2024-02-22T19:02:54.274 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2024-02-22T19:02:54.274 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2024-02-22T19:02:54.274 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2024-02-22T19:02:54.274 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2024-02-22T19:02:54.275 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2024-02-22T19:02:54.275 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:54.275 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2024-02-22T19:02:54.275 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-22T19:02:54.275 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2024-02-22T19:02:54.275 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2024-02-22T19:02:54.275 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:54.275 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2024-02-22T19:02:54.275 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2024-02-22T19:02:54.275 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2024-02-22T19:02:54.275 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2024-02-22T19:02:54.275 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2024-02-22T19:02:54.275 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2024-02-22T19:02:54.275 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:02:54.275 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-02-22T19:02:54.276 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:54.276 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2024-02-22T19:02:54.276 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-22T19:02:54.276 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2024-02-22T19:02:43.816408+0000", 2024-02-22T19:02:54.276 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-02-22T19:02:54.276 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:54.276 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2024-02-22T19:02:54.276 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:02:54.613 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:54 smithi062 bash[64101]: audit 2024-02-22T19:02:54.265954+0000 mon.a (mon.0) 9 : audit [DBG] from='client.? 172.21.15.62:0/2004221526' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-22T19:02:54.982 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:mgr not available, waiting (2/10)... 2024-02-22T19:02:55.984 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2024-02-22T19:02:55.984 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2024-02-22T19:02:55.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:55 smithi062 bash[64101]: cluster 2024-02-22T19:02:55.066497+0000 mon.a (mon.0) 10 : cluster [INF] Activating manager daemon y 2024-02-22T19:02:55.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:55 smithi062 bash[64101]: cluster 2024-02-22T19:02:55.071889+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00549603s) 2024-02-22T19:02:55.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:55 smithi062 bash[64101]: audit 2024-02-22T19:02:55.072374+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.62:0/984896284' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T19:02:55.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:55 smithi062 bash[64101]: audit 2024-02-22T19:02:55.072482+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.62:0/984896284' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T19:02:55.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:55 smithi062 bash[64101]: audit 2024-02-22T19:02:55.072583+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.62:0/984896284' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T19:02:55.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:55 smithi062 bash[64101]: audit 2024-02-22T19:02:55.073035+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.62:0/984896284' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T19:02:55.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:55 smithi062 bash[64101]: audit 2024-02-22T19:02:55.073209+0000 mon.a (mon.0) 16 : audit [DBG] from='mgr.14100 172.21.15.62:0/984896284' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T19:02:55.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:55 smithi062 bash[64101]: cluster 2024-02-22T19:02:55.086996+0000 mon.a (mon.0) 17 : cluster [INF] Manager daemon y is now available 2024-02-22T19:02:55.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:55 smithi062 bash[64101]: audit 2024-02-22T19:02:55.097215+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.62:0/984896284' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2024-02-22T19:02:55.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:55 smithi062 bash[64101]: audit 2024-02-22T19:02:55.529517+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.62:0/984896284' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2024-02-22T19:02:55.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:55 smithi062 bash[64101]: cluster 2024-02-22T19:02:55.529556+0000 mon.a (mon.0) 20 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-02-22T19:02:55.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:55 smithi062 bash[64101]: audit 2024-02-22T19:02:55.529793+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.62:0/984896284' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"3bba2b6e-e333-409b-8178-69d137701784"}]: dispatch 2024-02-22T19:02:55.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:55 smithi062 bash[64101]: audit 2024-02-22T19:02:55.532175+0000 mon.a (mon.0) 22 : audit [INF] from='mgr.14100 172.21.15.62:0/984896284' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"3bba2b6e-e333-409b-8178-69d137701784"}]': finished 2024-02-22T19:02:55.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:55 smithi062 bash[64101]: audit 2024-02-22T19:02:55.532397+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.14100 172.21.15.62:0/984896284' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T19:02:55.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:55 smithi062 bash[64101]: audit 2024-02-22T19:02:55.532689+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14100 172.21.15.62:0/984896284' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"faef26ce-2055-404b-8d22-218a78f29166"}]: dispatch 2024-02-22T19:02:55.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:55 smithi062 bash[64101]: audit 2024-02-22T19:02:55.537683+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14100 172.21.15.62:0/984896284' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"faef26ce-2055-404b-8d22-218a78f29166"}]': finished 2024-02-22T19:02:57.717 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:57 smithi062 bash[64101]: cluster 2024-02-22T19:02:56.077120+0000 mon.a (mon.0) 26 : cluster [DBG] mgrmap e3: y(active, since 1.01072s) 2024-02-22T19:02:57.717 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:57 smithi062 bash[64101]: audit 2024-02-22T19:02:56.536477+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.14100 172.21.15.62:0/984896284' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-22T19:02:57.717 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:57 smithi062 bash[64101]: cluster 2024-02-22T19:02:56.536524+0000 mon.a (mon.0) 28 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-02-22T19:02:57.717 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:57 smithi062 bash[64101]: audit 2024-02-22T19:02:56.538843+0000 mon.a (mon.0) 29 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-22T19:02:58.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:58 smithi062 bash[64101]: audit 2024-02-22T19:02:57.418933+0000 mon.a (mon.0) 30 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-22T19:02:58.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:58 smithi062 bash[64101]: cluster 2024-02-22T19:02:57.537171+0000 mon.a (mon.0) 31 : cluster [DBG] mgrmap e4: y(active, since 2s) 2024-02-22T19:02:59.018 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-22T19:02:59.019 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:02:59.019 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "e2bc0d14-d1b4-11ee-95bf-87774f69a715", 2024-02-22T19:02:59.019 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2024-02-22T19:02:59.019 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2024-02-22T19:02:59.019 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2024-02-22T19:02:59.019 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2024-02-22T19:02:59.019 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:59.019 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2024-02-22T19:02:59.019 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2024-02-22T19:02:59.019 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2024-02-22T19:02:59.019 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:02:59.019 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2024-02-22T19:02:59.019 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2024-02-22T19:02:59.019 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:02:59.019 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 9, 2024-02-22T19:02:59.020 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2024-02-22T19:02:59.020 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-22T19:02:59.020 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2024-02-22T19:02:59.020 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2024-02-22T19:02:59.020 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:59.020 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2024-02-22T19:02:59.020 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 3, 2024-02-22T19:02:59.020 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2024-02-22T19:02:59.020 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2024-02-22T19:02:59.020 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2024-02-22T19:02:59.020 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2024-02-22T19:02:59.020 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2024-02-22T19:02:59.020 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2024-02-22T19:02:59.020 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:59.020 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2024-02-22T19:02:59.021 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2024-02-22T19:02:59.021 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2024-02-22T19:02:59.021 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2024-02-22T19:02:59.021 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2024-02-22T19:02:59.021 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2024-02-22T19:02:59.021 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2024-02-22T19:02:59.021 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2024-02-22T19:02:59.021 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2024-02-22T19:02:59.021 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:59.021 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2024-02-22T19:02:59.021 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-22T19:02:59.021 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2024-02-22T19:02:59.021 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2024-02-22T19:02:59.021 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:59.021 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2024-02-22T19:02:59.022 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2024-02-22T19:02:59.022 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2024-02-22T19:02:59.022 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2024-02-22T19:02:59.022 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2024-02-22T19:02:59.022 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2024-02-22T19:02:59.022 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:02:59.022 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-02-22T19:02:59.022 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:59.022 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2024-02-22T19:02:59.022 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-22T19:02:59.022 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2024-02-22T19:02:43.816408+0000", 2024-02-22T19:02:59.022 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-02-22T19:02:59.022 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:02:59.022 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2024-02-22T19:02:59.022 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:02:59.645 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Enabling cephadm module... 2024-02-22T19:02:59.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'cephadm'] 2024-02-22T19:02:59.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable cephadm 2024-02-22T19:02:59.648 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:02:59 smithi062 bash[64101]: audit 2024-02-22T19:02:59.012905+0000 mon.a (mon.0) 32 : audit [DBG] from='client.? 172.21.15.62:0/2250297067' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-22T19:03:00.932 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:00 smithi062 bash[64101]: audit 2024-02-22T19:03:00.315329+0000 mon.a (mon.0) 33 : audit [INF] from='client.? 172.21.15.62:0/2708293325' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-22T19:03:00.932 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:00 smithi062 bash[64334]: ignoring --setuser ceph since I am not root 2024-02-22T19:03:00.932 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:00 smithi062 bash[64334]: ignoring --setgroup ceph since I am not root 2024-02-22T19:03:01.310 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2024-02-22T19:03:01.310 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2024-02-22T19:03:01.595 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:01 smithi062 bash[64101]: audit 2024-02-22T19:03:00.594665+0000 mon.a (mon.0) 34 : audit [INF] from='client.? 172.21.15.62:0/2708293325' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-22T19:03:01.595 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:01 smithi062 bash[64101]: cluster 2024-02-22T19:03:00.594719+0000 mon.a (mon.0) 35 : cluster [DBG] mgrmap e5: y(active, since 5s) 2024-02-22T19:03:02.146 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.147 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 5, 2024-02-22T19:03:02.147 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14100, 2024-02-22T19:03:02.147 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2024-02-22T19:03:02.147 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2024-02-22T19:03:02.147 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-22T19:03:02.147 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.147 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-22T19:03:02.147 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.62:6800", 2024-02-22T19:03:02.147 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 4224128405 2024-02-22T19:03:02.147 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.147 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.147 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2024-02-22T19:03:02.148 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.62:6801", 2024-02-22T19:03:02.148 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 4224128405 2024-02-22T19:03:02.148 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.148 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-22T19:03:02.148 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.148 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.15.62:6801/4224128405", 2024-02-22T19:03:02.148 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2024-02-22T19:02:55.066384+0000", 2024-02-22T19:03:02.148 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2024-02-22T19:03:02.148 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2024-02-22T19:03:02.148 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2024-02-22T19:03:02.148 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2024-02-22T19:03:02.148 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2024-02-22T19:03:02.148 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2024-02-22T19:03:02.149 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2024-02-22T19:03:02.149 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.149 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2024-02-22T19:03:02.149 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.149 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2024-02-22T19:03:02.149 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.149 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-22T19:03:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-22T19:03:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.553 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-22T19:03:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2024-02-22T19:03:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2024-02-22T19:03:02.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2024-02-22T19:03:02.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2024-02-22T19:03:02.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2024-02-22T19:03:02.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2024-02-22T19:03:02.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2024-02-22T19:03:02.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2024-02-22T19:03:02.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2024-02-22T19:03:02.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2024-02-22T19:03:02.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2024-02-22T19:03:02.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2024-02-22T19:03:02.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2024-02-22T19:03:02.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2024-02-22T19:03:02.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2024-02-22T19:03:02.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2024-02-22T19:03:02.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2024-02-22T19:03:02.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2024-02-22T19:03:02.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2024-02-22T19:03:02.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2024-02-22T19:03:02.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2024-02-22T19:03:02.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2024-02-22T19:03:02.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2024-02-22T19:03:02.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2024-02-22T19:03:02.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2024-02-22T19:03:02.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2024-02-22T19:03:02.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2024-02-22T19:03:02.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2024-02-22T19:03:02.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2024-02-22T19:03:02.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2024-02-22T19:03:02.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2024-02-22T19:03:02.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2024-02-22T19:03:02.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2024-02-22T19:03:02.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2024-02-22T19:03:02.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2024-02-22T19:03:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2024-02-22T19:03:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2024-02-22T19:03:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2024-02-22T19:03:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-22T19:03:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-02-22T19:03:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2024-02-22T19:03:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2024-02-22T19:03:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2024-02-22T19:03:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2024-02-22T19:03:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2024-02-22T19:03:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2024-02-22T19:03:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-22T19:03:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2024-02-22T19:03:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2024-02-22T19:03:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2024-02-22T19:03:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2024-02-22T19:03:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2024-02-22T19:03:02.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2024-02-22T19:03:02.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2024-02-22T19:03:02.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2024-02-22T19:03:02.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-02-22T19:03:02.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2024-02-22T19:03:02.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2024-02-22T19:03:02.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-02-22T19:03:02.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2024-02-22T19:03:02.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2024-02-22T19:03:02.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2024-02-22T19:03:02.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2024-02-22T19:03:02.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-02-22T19:03:02.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2024-02-22T19:03:02.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2024-02-22T19:03:02.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2024-02-22T19:03:02.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2024-02-22T19:03:02.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2024-02-22T19:03:02.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2024-02-22T19:03:02.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2024-02-22T19:03:02.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-22T19:03:02.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2024-02-22T19:03:02.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2024-02-22T19:03:02.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2024-02-22T19:03:02.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-02-22T19:03:02.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2024-02-22T19:03:02.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2024-02-22T19:03:02.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2024-02-22T19:03:02.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-02-22T19:03:02.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-02-22T19:03:02.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2024-02-22T19:03:02.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2024-02-22T19:03:02.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2024-02-22T19:03:02.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2024-02-22T19:03:02.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2024-02-22T19:03:02.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2024-02-22T19:03:02.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2024-02-22T19:03:02.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2024-02-22T19:03:02.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2024-02-22T19:03:02.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2024-02-22T19:03:02.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2024-02-22T19:03:02.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-22T19:03:02.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-22T19:03:02.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:02.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-22T19:03:02.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2024-02-22T19:03:02.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2024-02-22T19:03:02.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2024-02-22T19:03:02.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-22T19:03:02.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2024-02-22T19:03:02.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2024-02-22T19:03:02.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-02-22T19:03:02.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2024-02-22T19:03:02.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2024-02-22T19:03:02.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-22T19:03:02.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-22T19:03:02.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2024-02-22T19:03:02.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2024-02-22T19:03:02.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2024-02-22T19:03:02.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2024-02-22T19:03:02.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2024-02-22T19:03:02.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-02-22T19:03:02.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2024-02-22T19:03:02.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2024-02-22T19:03:02.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2024-02-22T19:03:02.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2024-02-22T19:03:02.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2024-02-22T19:03:02.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2024-02-22T19:03:02.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:02.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-22T19:03:02.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2024-02-22T19:03:02.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2024-02-22T19:03:02.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2024-02-22T19:03:02.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:02.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2024-02-22T19:03:02.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2024-02-22T19:03:02.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2024-02-22T19:03:02.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2024-02-22T19:03:02.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:02.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-22T19:03:02.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2024-02-22T19:03:02.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2024-02-22T19:03:02.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2024-02-22T19:03:02.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2024-02-22T19:03:02.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2024-02-22T19:03:02.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2024-02-22T19:03:02.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2024-02-22T19:03:02.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2024-02-22T19:03:02.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2024-02-22T19:03:02.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2024-02-22T19:03:02.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-22T19:03:02.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2024-02-22T19:03:02.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2024-02-22T19:03:02.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2024-02-22T19:03:02.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2024-02-22T19:03:02.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2024-02-22T19:03:02.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2024-02-22T19:03:02.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-02-22T19:03:02.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2024-02-22T19:03:02.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2024-02-22T19:03:02.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-02-22T19:03:02.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2024-02-22T19:03:02.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2024-02-22T19:03:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2024-02-22T19:03:02.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2024-02-22T19:03:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2024-02-22T19:03:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2024-02-22T19:03:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2024-02-22T19:03:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:02.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2024-02-22T19:03:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2024-02-22T19:03:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2024-02-22T19:03:02.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2024-02-22T19:03:02.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2024-02-22T19:03:02.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2024-02-22T19:03:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2024-02-22T19:03:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2024-02-22T19:03:02.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2024-02-22T19:03:02.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2024-02-22T19:03:02.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2024-02-22T19:03:02.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2024-02-22T19:03:02.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2024-02-22T19:03:02.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2024-02-22T19:03:02.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2024-02-22T19:03:02.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2024-02-22T19:03:02.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2024-02-22T19:03:02.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2024-02-22T19:03:02.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2024-02-22T19:03:02.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2024-02-22T19:03:02.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2024-02-22T19:03:02.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2024-02-22T19:03:02.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2024-02-22T19:03:02.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-02-22T19:03:02.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-02-22T19:03:02.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2024-02-22T19:03:02.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2024-02-22T19:03:02.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-02-22T19:03:02.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2024-02-22T19:03:02.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2024-02-22T19:03:02.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2024-02-22T19:03:02.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2024-02-22T19:03:02.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2024-02-22T19:03:02.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2024-02-22T19:03:02.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-02-22T19:03:02.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2024-02-22T19:03:02.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-02-22T19:03:02.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2024-02-22T19:03:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2024-02-22T19:03:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2024-02-22T19:03:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2024-02-22T19:03:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-02-22T19:03:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-02-22T19:03:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-02-22T19:03:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-02-22T19:03:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-02-22T19:03:02.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-02-22T19:03:02.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-02-22T19:03:02.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-02-22T19:03:02.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-02-22T19:03:02.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-02-22T19:03:02.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-02-22T19:03:02.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-02-22T19:03:02.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-02-22T19:03:02.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-02-22T19:03:02.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2024-02-22T19:03:02.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2024-02-22T19:03:02.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2024-02-22T19:03:02.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2024-02-22T19:03:02.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-02-22T19:03:02.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2024-02-22T19:03:02.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-02-22T19:03:02.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-22T19:03:02.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2024-02-22T19:03:02.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2024-02-22T19:03:02.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2024-02-22T19:03:02.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2024-02-22T19:03:02.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2024-02-22T19:03:02.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2024-02-22T19:03:02.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2024-02-22T19:03:02.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2024-02-22T19:03:02.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2024-02-22T19:03:02.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2024-02-22T19:03:02.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-02-22T19:03:02.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2024-02-22T19:03:02.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2024-02-22T19:03:02.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2024-02-22T19:03:02.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2024-02-22T19:03:02.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2024-02-22T19:03:02.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2024-02-22T19:03:02.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2024-02-22T19:03:02.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2024-02-22T19:03:02.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2024-02-22T19:03:02.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2024-02-22T19:03:02.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2024-02-22T19:03:02.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2024-02-22T19:03:02.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2024-02-22T19:03:02.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2024-02-22T19:03:02.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2024-02-22T19:03:02.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2024-02-22T19:03:02.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-02-22T19:03:02.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2024-02-22T19:03:02.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-02-22T19:03:02.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-22T19:03:02.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2024-02-22T19:03:02.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-02-22T19:03:02.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-22T19:03:02.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2024-02-22T19:03:02.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2024-02-22T19:03:02.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2024-02-22T19:03:02.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2024-02-22T19:03:02.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2024-02-22T19:03:02.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2024-02-22T19:03:02.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2024-02-22T19:03:02.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2024-02-22T19:03:02.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2024-02-22T19:03:02.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2024-02-22T19:03:02.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2024-02-22T19:03:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2024-02-22T19:03:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-02-22T19:03:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-02-22T19:03:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2024-02-22T19:03:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-02-22T19:03:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-02-22T19:03:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2024-02-22T19:03:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2024-02-22T19:03:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2024-02-22T19:03:02.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2024-02-22T19:03:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2024-02-22T19:03:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2024-02-22T19:03:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2024-02-22T19:03:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2024-02-22T19:03:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2024-02-22T19:03:02.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2024-02-22T19:03:02.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2024-02-22T19:03:02.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2024-02-22T19:03:02.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2024-02-22T19:03:02.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2024-02-22T19:03:02.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2024-02-22T19:03:02.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2024-02-22T19:03:02.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2024-02-22T19:03:02.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2024-02-22T19:03:02.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2024-02-22T19:03:02.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2024-02-22T19:03:02.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2024-02-22T19:03:02.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2024-02-22T19:03:02.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2024-02-22T19:03:02.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2024-02-22T19:03:02.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2024-02-22T19:03:02.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:02.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2024-02-22T19:03:02.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2024-02-22T19:03:02.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2024-02-22T19:03:02.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2024-02-22T19:03:02.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2024-02-22T19:03:02.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2024-02-22T19:03:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2024-02-22T19:03:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2024-02-22T19:03:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2024-02-22T19:03:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2024-02-22T19:03:02.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2024-02-22T19:03:02.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2024-02-22T19:03:02.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:02.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2024-02-22T19:03:02.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2024-02-22T19:03:02.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2024-02-22T19:03:02.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2024-02-22T19:03:02.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2024-02-22T19:03:02.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-22T19:03:02.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-22T19:03:02.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:02.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-22T19:03:02.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2024-02-22T19:03:02.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2024-02-22T19:03:02.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2024-02-22T19:03:02.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:02.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2024-02-22T19:03:02.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2024-02-22T19:03:02.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2024-02-22T19:03:02.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2024-02-22T19:03:02.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2024-02-22T19:03:02.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2024-02-22T19:03:02.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2024-02-22T19:03:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2024-02-22T19:03:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2024-02-22T19:03:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-22T19:03:02.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-22T19:03:02.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-22T19:03:02.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2024-02-22T19:03:02.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2024-02-22T19:03:02.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2024-02-22T19:03:02.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2024-02-22T19:03:02.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2024-02-22T19:03:02.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2024-02-22T19:03:02.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2024-02-22T19:03:02.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2024-02-22T19:03:02.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2024-02-22T19:03:02.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2024-02-22T19:03:02.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2024-02-22T19:03:02.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-22T19:03:02.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-22T19:03:02.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-22T19:03:02.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2024-02-22T19:03:02.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2024-02-22T19:03:02.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2024-02-22T19:03:02.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-22T19:03:02.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2024-02-22T19:03:02.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2024-02-22T19:03:02.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2024-02-22T19:03:02.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2024-02-22T19:03:02.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2024-02-22T19:03:02.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2024-02-22T19:03:02.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2024-02-22T19:03:02.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2024-02-22T19:03:02.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-22T19:03:02.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2024-02-22T19:03:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2024-02-22T19:03:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-22T19:03:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2024-02-22T19:03:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2024-02-22T19:03:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2024-02-22T19:03:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2024-02-22T19:03:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2024-02-22T19:03:02.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2024-02-22T19:03:02.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2024-02-22T19:03:02.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2024-02-22T19:03:02.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2024-02-22T19:03:02.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2024-02-22T19:03:02.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2024-02-22T19:03:02.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2024-02-22T19:03:02.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-22T19:03:02.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2024-02-22T19:03:02.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2024-02-22T19:03:02.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2024-02-22T19:03:02.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2024-02-22T19:03:02.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2024-02-22T19:03:02.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2024-02-22T19:03:02.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2024-02-22T19:03:02.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2024-02-22T19:03:02.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2024-02-22T19:03:02.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2024-02-22T19:03:02.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2024-02-22T19:03:02.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2024-02-22T19:03:02.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2024-02-22T19:03:02.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2024-02-22T19:03:02.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2024-02-22T19:03:02.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2024-02-22T19:03:02.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2024-02-22T19:03:02.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2024-02-22T19:03:02.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2024-02-22T19:03:02.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2024-02-22T19:03:02.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2024-02-22T19:03:02.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2024-02-22T19:03:02.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2024-02-22T19:03:02.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2024-02-22T19:03:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2024-02-22T19:03:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2024-02-22T19:03:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2024-02-22T19:03:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2024-02-22T19:03:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-22T19:03:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2024-02-22T19:03:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2024-02-22T19:03:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2024-02-22T19:03:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2024-02-22T19:03:02.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2024-02-22T19:03:02.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2024-02-22T19:03:02.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-22T19:03:02.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-22T19:03:02.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-22T19:03:02.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2024-02-22T19:03:02.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2024-02-22T19:03:02.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2024-02-22T19:03:02.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2024-02-22T19:03:02.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2024-02-22T19:03:02.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2024-02-22T19:03:02.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2024-02-22T19:03:02.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:02.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-22T19:03:02.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2024-02-22T19:03:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2024-02-22T19:03:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2024-02-22T19:03:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2024-02-22T19:03:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2024-02-22T19:03:02.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2024-02-22T19:03:02.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2024-02-22T19:03:02.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2024-02-22T19:03:02.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-02-22T19:03:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-02-22T19:03:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-02-22T19:03:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-02-22T19:03:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2024-02-22T19:03:02.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2024-02-22T19:03:02.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2024-02-22T19:03:02.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2024-02-22T19:03:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2024-02-22T19:03:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2024-02-22T19:03:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2024-02-22T19:03:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2024-02-22T19:03:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-02-22T19:03:02.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-02-22T19:03:02.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-02-22T19:03:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-02-22T19:03:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2024-02-22T19:03:02.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2024-02-22T19:03:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2024-02-22T19:03:02.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2024-02-22T19:03:02.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2024-02-22T19:03:02.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2024-02-22T19:03:02.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2024-02-22T19:03:02.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2024-02-22T19:03:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2024-02-22T19:03:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2024-02-22T19:03:02.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2024-02-22T19:03:02.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2024-02-22T19:03:02.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2024-02-22T19:03:02.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-02-22T19:03:02.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2024-02-22T19:03:02.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2024-02-22T19:03:02.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2024-02-22T19:03:02.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2024-02-22T19:03:02.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2024-02-22T19:03:02.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2024-02-22T19:03:02.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2024-02-22T19:03:02.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2024-02-22T19:03:02.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2024-02-22T19:03:02.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2024-02-22T19:03:02.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2024-02-22T19:03:02.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2024-02-22T19:03:02.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2024-02-22T19:03:02.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2024-02-22T19:03:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2024-02-22T19:03:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2024-02-22T19:03:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2024-02-22T19:03:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-22T19:03:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-22T19:03:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2024-02-22T19:03:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2024-02-22T19:03:02.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2024-02-22T19:03:02.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2024-02-22T19:03:02.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2024-02-22T19:03:02.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2024-02-22T19:03:02.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2024-02-22T19:03:02.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2024-02-22T19:03:02.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2024-02-22T19:03:02.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:02.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2024-02-22T19:03:02.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2024-02-22T19:03:02.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2024-02-22T19:03:02.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2024-02-22T19:03:02.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-22T19:03:02.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.817 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2024-02-22T19:03:02.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2024-02-22T19:03:02.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-22T19:03:02.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2024-02-22T19:03:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2024-02-22T19:03:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2024-02-22T19:03:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2024-02-22T19:03:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2024-02-22T19:03:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-22T19:03:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-22T19:03:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2024-02-22T19:03:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2024-02-22T19:03:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2024-02-22T19:03:02.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2024-02-22T19:03:02.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2024-02-22T19:03:02.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2024-02-22T19:03:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2024-02-22T19:03:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2024-02-22T19:03:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2024-02-22T19:03:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-22T19:03:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2024-02-22T19:03:02.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2024-02-22T19:03:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-22T19:03:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2024-02-22T19:03:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2024-02-22T19:03:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2024-02-22T19:03:02.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2024-02-22T19:03:02.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2024-02-22T19:03:02.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2024-02-22T19:03:02.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:02.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:02.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:02.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2024-02-22T19:03:02.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2024-02-22T19:03:02.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2024-02-22T19:03:02.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2024-02-22T19:03:02.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2024-02-22T19:03:02.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-22T19:03:02.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-22T19:03:02.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:02.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-22T19:03:02.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:02.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:02.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:02.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:02.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:02.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:02.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:02.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:02.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:02.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:02.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:02.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:02.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:02.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:02.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:02.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:02.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:02.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:02.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:02.851 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:02.851 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.851 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.851 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.851 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.851 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.851 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.851 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.851 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.851 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2024-02-22T19:03:02.851 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2024-02-22T19:03:02.851 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.851 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.851 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.851 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-22T19:03:02.852 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.852 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.852 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.852 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.852 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.852 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.852 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.852 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.852 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2024-02-22T19:03:02.852 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2024-02-22T19:03:02.852 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:02.852 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.852 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.852 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2024-02-22T19:03:02.852 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.853 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.853 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.853 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.853 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.853 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.853 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.853 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.853 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2024-02-22T19:03:02.853 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2024-02-22T19:03:02.853 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:02.853 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:02.853 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:02.853 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2024-02-22T19:03:02.854 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:02.854 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:02.854 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:02.854 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:02.854 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:02.854 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:02.854 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:02.854 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.854 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.854 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.854 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.854 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2024-02-22T19:03:02.854 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2024-02-22T19:03:02.854 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2024-02-22T19:03:02.854 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2024-02-22T19:03:02.855 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2024-02-22T19:03:02.855 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2024-02-22T19:03:02.855 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2024-02-22T19:03:02.855 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2024-02-22T19:03:02.855 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2024-02-22T19:03:02.855 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2024-02-22T19:03:02.855 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2024-02-22T19:03:02.855 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.855 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2024-02-22T19:03:02.855 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2024-02-22T19:03:02.855 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2024-02-22T19:03:02.855 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2024-02-22T19:03:02.855 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2024-02-22T19:03:02.855 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2024-02-22T19:03:02.855 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2024-02-22T19:03:02.856 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2024-02-22T19:03:02.856 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2024-02-22T19:03:02.856 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2024-02-22T19:03:02.856 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2024-02-22T19:03:02.856 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2024-02-22T19:03:02.856 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:02.856 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 0, 2024-02-22T19:03:02.856 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2024-02-22T19:03:02.856 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.856 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-22T19:03:02.856 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.856 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-22T19:03:02.856 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.62:0", 2024-02-22T19:03:02.856 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 3302131045 2024-02-22T19:03:02.856 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.857 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-22T19:03:02.857 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.857 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.857 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-22T19:03:02.857 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.857 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-22T19:03:02.857 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.62:0", 2024-02-22T19:03:02.857 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 3176223692 2024-02-22T19:03:02.857 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.857 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-22T19:03:02.857 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:02.857 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.857 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-22T19:03:02.857 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:02.857 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-22T19:03:02.858 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.62:0", 2024-02-22T19:03:02.858 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2038195977 2024-02-22T19:03:02.858 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.858 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-22T19:03:02.858 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.858 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-22T19:03:02.858 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.858 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:02.918 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Waiting for the mgr to restart... 2024-02-22T19:03:02.918 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Waiting for Mgr epoch 5... 2024-02-22T19:03:02.918 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2024-02-22T19:03:02.918 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2024-02-22T19:03:02.920 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:02 smithi062 bash[64101]: audit 2024-02-22T19:03:02.140723+0000 mon.a (mon.0) 36 : audit [DBG] from='client.? 172.21.15.62:0/3963338510' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2024-02-22T19:03:04.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:04 smithi062 bash[64101]: cluster 2024-02-22T19:03:04.422746+0000 mon.a (mon.0) 37 : cluster [INF] Active manager daemon y restarted 2024-02-22T19:03:04.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:04 smithi062 bash[64101]: cluster 2024-02-22T19:03:04.423129+0000 mon.a (mon.0) 38 : cluster [INF] Activating manager daemon y 2024-02-22T19:03:04.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:04 smithi062 bash[64101]: cluster 2024-02-22T19:03:04.427094+0000 mon.a (mon.0) 39 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-22T19:03:05.494 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:05.494 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 7, 2024-02-22T19:03:05.494 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2024-02-22T19:03:05.494 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:05.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:05 smithi062 bash[64101]: cluster 2024-02-22T19:03:04.475569+0000 mon.a (mon.0) 40 : cluster [DBG] mgrmap e6: y(active, starting, since 0.0525052s) 2024-02-22T19:03:05.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:05 smithi062 bash[64101]: audit 2024-02-22T19:03:04.477650+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T19:03:05.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:05 smithi062 bash[64101]: audit 2024-02-22T19:03:04.478344+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T19:03:05.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:05 smithi062 bash[64101]: audit 2024-02-22T19:03:04.478446+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T19:03:05.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:05 smithi062 bash[64101]: audit 2024-02-22T19:03:04.478555+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T19:03:05.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:05 smithi062 bash[64101]: audit 2024-02-22T19:03:04.478870+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T19:03:05.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:05 smithi062 bash[64101]: audit 2024-02-22T19:03:04.480914+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T19:03:05.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:05 smithi062 bash[64101]: audit 2024-02-22T19:03:04.481151+0000 mon.a (mon.0) 47 : audit [DBG] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T19:03:05.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:05 smithi062 bash[64101]: cluster 2024-02-22T19:03:04.494955+0000 mon.a (mon.0) 48 : cluster [INF] Manager daemon y is now available 2024-02-22T19:03:05.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:05 smithi062 bash[64101]: audit 2024-02-22T19:03:04.515517+0000 mon.a (mon.0) 49 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-22T19:03:05.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:05 smithi062 bash[64101]: audit 2024-02-22T19:03:05.396145+0000 mon.a (mon.0) 50 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-22T19:03:06.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:06 smithi062 bash[64101]: cluster 2024-02-22T19:03:05.485793+0000 mon.a (mon.0) 51 : cluster [DBG] mgrmap e7: y(active, since 1.06272s) 2024-02-22T19:03:07.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:07 smithi062 bash[64101]: cluster 2024-02-22T19:03:06.488791+0000 mon.a (mon.0) 52 : cluster [DBG] mgrmap e8: y(active, since 2s) 2024-02-22T19:03:10.475 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Setting orchestrator backend to cephadm... 2024-02-22T19:03:10.475 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'set', 'backend', 'cephadm'] 2024-02-22T19:03:10.476 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch set backend cephadm 2024-02-22T19:03:13.906 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:13 smithi062 bash[64101]: audit 2024-02-22T19:03:13.559465+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd=[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]: dispatch 2024-02-22T19:03:13.906 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:13 smithi062 bash[64101]: audit 2024-02-22T19:03:13.561940+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd='[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]': finished 2024-02-22T19:03:14.201 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Generating ssh key... 2024-02-22T19:03:14.201 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'generate-key'] 2024-02-22T19:03:14.201 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm generate-key 2024-02-22T19:03:14.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:14 smithi062 bash[64101]: audit 2024-02-22T19:03:13.558261+0000 mgr.y (mgr.14117) 1 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:03:15.479 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64334]: Generating public/private rsa key pair. 2024-02-22T19:03:15.479 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64334]: Your identification has been saved in /tmp/tmpi975f8p6/key. 2024-02-22T19:03:15.479 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64334]: Your public key has been saved in /tmp/tmpi975f8p6/key.pub. 2024-02-22T19:03:15.479 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64334]: The key fingerprint is: 2024-02-22T19:03:15.479 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64334]: SHA256:Ktk/a3AtBLaXVH+Y9k4KlSfC7KL/G0jMplfUsZgGFec ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:03:15.480 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64334]: The key's randomart image is: 2024-02-22T19:03:15.480 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64334]: +---[RSA 3072]----+ 2024-02-22T19:03:15.480 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64334]: | .o+.o | 2024-02-22T19:03:15.480 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64334]: | o .+ B * | 2024-02-22T19:03:15.480 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64334]: | . + .O E o | 2024-02-22T19:03:15.480 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64334]: | .o++ + = | 2024-02-22T19:03:15.480 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64334]: | oS.+ o | 2024-02-22T19:03:15.480 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64334]: | o.*o+.. + | 2024-02-22T19:03:15.480 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64334]: | o =oo.. . . | 2024-02-22T19:03:15.480 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64334]: | . +o . | 2024-02-22T19:03:15.480 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64334]: | .++o. | 2024-02-22T19:03:15.480 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64334]: +----[SHA256]-----+ 2024-02-22T19:03:15.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64101]: audit 2024-02-22T19:03:15.208003+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEA5gMhNSTPb1ZRTRJsCB4mZ22w1sBLZ11r2kKPzd+/bcTv+nQkjqYF\nBLmF8L+ER3UPHSdKoVUjaoam1MYnt/NKth3ej8AqS99fmbELH2xaP8lSaYfTXZLPuvcA3w\nbKGfJ+O1FSfc/O56buRWDsfMOZnoz3565s3bL8gkHncEWjpqODGgFz0LpTKyHixRZln74L\nxRKPEiH5f+gP/RYpzM587jU6157Vcp+fqOm6lTxOZSwuG4k8u+L5JHGVry0GOUYaHmftTF\nr8AwEuNzmSkfckA6x26xHl7kN0k6jgswdoUR6HeoT21jMJ2ybsGC5Na+ovAs6u9r3EwA5F\nssUPAQ6njuL9tpWxSMmNCRahevO56CGyIiAhEPKqZiThPWu7DbUEpYEYts8GpenXfq+E3z\n1cHWJnCoo/2DF3QEb2vj7mHg2Vp632ptuPNCI2XKx/GFmBbOfT3svmdVAd6IkkNdCrE1tC\nB9fYwugG5D+CE6e5m9cJDE76qfc/xOjg5MjJoohzAAAFoEnSfWxJ0n1sAAAAB3NzaC1yc2\nEAAAGBAOYDITUkz29WUU0SbAgeJmdtsNbAS2dda9pCj83fv23E7/p0JI6mBQS5hfC/hEd1\nDx0nSqFVI2qGptTGJ7fzSrYd3o/AKkvfX5mxCx9sWj/JUmmH012Sz7r3AN8GyhnyfjtRUn\n3Pzuem7kVg7HzDmZ6M9+eubN2y/IJB53BFo6ajgxoBc9C6Uysh4sUWZZ++C8USjxIh+X/o\nD/0WKczOfO41Otee1XKfn6jpupU8TmUsLhuJPLvi+SRxla8tBjlGGh5n7Uxa/AMBLjc5kp\nH3JAOsdusR5e5DdJOo4LMHaFEeh3qE9tYzCdsm7BguTWvqLwLOrva9xMAORbLFDwEOp47i\n/baVsUjJjQkWoXrzueghsiIgIRDyqmYk4T1ruw21BKWBGLbPBqXp136vhN89XB1iZwqKP9\ngxd0BG9r4+5h4Nlaet9qbbjzQiNlysfxhZgWzn097L5nVQHeiJJDXQqxNbQgfX2MLoBuQ/\nghOnuZvXCQxO+qn3P8To4OTIyaKIcwAAAAMBAAEAAAGAXsydbCzevfGikpRsKDBc/bXs86\nXPriuH3y4d3OlCGbjYe65QvuZYHSllteMJXvY1I3vlO3c+oJIcwodlKWDBwyuuZir6g8jt\nuweIIQxkafPM3qfXirKOoW1aU5GVzHnwYvxSdn4mtb1MaRXYglePwhQxvLBcOEej4P/Opq\nxdFbpAt4AvvrB8xMMzlq1zdxI6AaBzjTKphXkc1d/DnKDiRr9zoBjbumFlyZWDjCyN1w8N\nddXrTTjwHIAgBFIXRZXJN+l/2NyX8a20CXt3dPKFF3nlSV3lwqWVr0oZpXV3qq6HOBzmJg\n2Klm5S+J0VkWANeS6NK45hQDvb/HD4HSk9Uhe4uMYe1BIF8md2cmmwukbNjT0cZ4y552NN\njMCSq5uNCrS1LtYVM8Omj5lfX0x03r4gMlRsbYfZUtchO4Ohm1WOgVbJLbFO2JLXyfJel0\nR1tqrTJ8Do3s4ZB7qSo13ijyH77eM8MLOoGxdDZCa7uIeJHgMthZakPw7DxBS8VpbJAAAA\nwAv1yARejBvyZD4bSylPzYSM+A9XewPenZqY5u6hggpSB6CwB8FMP7uj8KfEFv/FIKQps3\nnESvQU5/qb/vnBr4TBGZkyE+08knFj5g5ehN+BlbHIZpmnxibX+uwUtlmCqGr2irmGaL1z\nVUuqDuEKgHIImsnk4TsWoiNe4MXG5LSSdlDDn0XtWRfwcHDza/TnPRzonV80OCL+uaLy+b\nLOLPul9ZgfvtRnOBqrAJPz7SBQ4xFzvDMZrj4LNF3ByiudsAAAAMEA+vDsZC268IQv3ydo\nqNEy5RGBFXkXfCBPhOsCNF1FOeJgcEwCbB/qRIoZGafoVjLK1zFc201wiXb9T8XELQqtCt\n701zY7MqFyXAFQYUq8QwY5UFfT22ZT+e5By+dNMN6eYspDrVZYRJzyeAMCQDVBxSjmiWSV\npokzqcbp7nNuGlOG0aJvG/TZFxZu9ivldiuEKjXI/0sIKuXN4o9sc7qZph6obhHSpy60WN\nerrYSW7YDMAwrnDwm6BRcbPZa323u3AAAAwQDqpjHksb5h+vtzm68/WO5ckfMGyLSCii6r\nSRr+nvFcOu5KlXkI/5V9fP6Z8qzJxC2TudhUBkHb13j8Lzch6KP7W4inlGNY9NIVPQn2X6\nbSHviHrhvcx5GDvCALc58PK8lidQVIS8kKxWZFH16qjt0UU7VKXr3I3r4lXI5APRNtzHvl\nZWHCoADToDbGHtyf8UQwmPw+XUFHFFe4hzI87h7gEmexV8KvYv4cXy4LSJoKJ1PaZXOieH\nAAQfXZKCbhkSUAAAApY2VwaC1lMmJjMGQxNC1kMWI0LTExZWUtOTViZi04Nzc3NGY2OWE3\nMTUBAg==\n-----END OPENSSH PRIVATE KEY-----\n"}]: dispatch 2024-02-22T19:03:15.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64101]: audit 2024-02-22T19:03:15.209807+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEA5gMhNSTPb1ZRTRJsCB4mZ22w1sBLZ11r2kKPzd+/bcTv+nQkjqYF\nBLmF8L+ER3UPHSdKoVUjaoam1MYnt/NKth3ej8AqS99fmbELH2xaP8lSaYfTXZLPuvcA3w\nbKGfJ+O1FSfc/O56buRWDsfMOZnoz3565s3bL8gkHncEWjpqODGgFz0LpTKyHixRZln74L\nxRKPEiH5f+gP/RYpzM587jU6157Vcp+fqOm6lTxOZSwuG4k8u+L5JHGVry0GOUYaHmftTF\nr8AwEuNzmSkfckA6x26xHl7kN0k6jgswdoUR6HeoT21jMJ2ybsGC5Na+ovAs6u9r3EwA5F\nssUPAQ6njuL9tpWxSMmNCRahevO56CGyIiAhEPKqZiThPWu7DbUEpYEYts8GpenXfq+E3z\n1cHWJnCoo/2DF3QEb2vj7mHg2Vp632ptuPNCI2XKx/GFmBbOfT3svmdVAd6IkkNdCrE1tC\nB9fYwugG5D+CE6e5m9cJDE76qfc/xOjg5MjJoohzAAAFoEnSfWxJ0n1sAAAAB3NzaC1yc2\nEAAAGBAOYDITUkz29WUU0SbAgeJmdtsNbAS2dda9pCj83fv23E7/p0JI6mBQS5hfC/hEd1\nDx0nSqFVI2qGptTGJ7fzSrYd3o/AKkvfX5mxCx9sWj/JUmmH012Sz7r3AN8GyhnyfjtRUn\n3Pzuem7kVg7HzDmZ6M9+eubN2y/IJB53BFo6ajgxoBc9C6Uysh4sUWZZ++C8USjxIh+X/o\nD/0WKczOfO41Otee1XKfn6jpupU8TmUsLhuJPLvi+SRxla8tBjlGGh5n7Uxa/AMBLjc5kp\nH3JAOsdusR5e5DdJOo4LMHaFEeh3qE9tYzCdsm7BguTWvqLwLOrva9xMAORbLFDwEOp47i\n/baVsUjJjQkWoXrzueghsiIgIRDyqmYk4T1ruw21BKWBGLbPBqXp136vhN89XB1iZwqKP9\ngxd0BG9r4+5h4Nlaet9qbbjzQiNlysfxhZgWzn097L5nVQHeiJJDXQqxNbQgfX2MLoBuQ/\nghOnuZvXCQxO+qn3P8To4OTIyaKIcwAAAAMBAAEAAAGAXsydbCzevfGikpRsKDBc/bXs86\nXPriuH3y4d3OlCGbjYe65QvuZYHSllteMJXvY1I3vlO3c+oJIcwodlKWDBwyuuZir6g8jt\nuweIIQxkafPM3qfXirKOoW1aU5GVzHnwYvxSdn4mtb1MaRXYglePwhQxvLBcOEej4P/Opq\nxdFbpAt4AvvrB8xMMzlq1zdxI6AaBzjTKphXkc1d/DnKDiRr9zoBjbumFlyZWDjCyN1w8N\nddXrTTjwHIAgBFIXRZXJN+l/2NyX8a20CXt3dPKFF3nlSV3lwqWVr0oZpXV3qq6HOBzmJg\n2Klm5S+J0VkWANeS6NK45hQDvb/HD4HSk9Uhe4uMYe1BIF8md2cmmwukbNjT0cZ4y552NN\njMCSq5uNCrS1LtYVM8Omj5lfX0x03r4gMlRsbYfZUtchO4Ohm1WOgVbJLbFO2JLXyfJel0\nR1tqrTJ8Do3s4ZB7qSo13ijyH77eM8MLOoGxdDZCa7uIeJHgMthZakPw7DxBS8VpbJAAAA\nwAv1yARejBvyZD4bSylPzYSM+A9XewPenZqY5u6hggpSB6CwB8FMP7uj8KfEFv/FIKQps3\nnESvQU5/qb/vnBr4TBGZkyE+08knFj5g5ehN+BlbHIZpmnxibX+uwUtlmCqGr2irmGaL1z\nVUuqDuEKgHIImsnk4TsWoiNe4MXG5LSSdlDDn0XtWRfwcHDza/TnPRzonV80OCL+uaLy+b\nLOLPul9ZgfvtRnOBqrAJPz7SBQ4xFzvDMZrj4LNF3ByiudsAAAAMEA+vDsZC268IQv3ydo\nqNEy5RGBFXkXfCBPhOsCNF1FOeJgcEwCbB/qRIoZGafoVjLK1zFc201wiXb9T8XELQqtCt\n701zY7MqFyXAFQYUq8QwY5UFfT22ZT+e5By+dNMN6eYspDrVZYRJzyeAMCQDVBxSjmiWSV\npokzqcbp7nNuGlOG0aJvG/TZFxZu9ivldiuEKjXI/0sIKuXN4o9sc7qZph6obhHSpy60WN\nerrYSW7YDMAwrnDwm6BRcbPZa323u3AAAAwQDqpjHksb5h+vtzm68/WO5ckfMGyLSCii6r\nSRr+nvFcOu5KlXkI/5V9fP6Z8qzJxC2TudhUBkHb13j8Lzch6KP7W4inlGNY9NIVPQn2X6\nbSHviHrhvcx5GDvCALc58PK8lidQVIS8kKxWZFH16qjt0UU7VKXr3I3r4lXI5APRNtzHvl\nZWHCoADToDbGHtyf8UQwmPw+XUFHFFe4hzI87h7gEmexV8KvYv4cXy4LSJoKJ1PaZXOieH\nAAQfXZKCbhkSUAAAApY2VwaC1lMmJjMGQxNC1kMWI0LTExZWUtOTViZi04Nzc3NGY2OWE3\nMTUBAg==\n-----END OPENSSH PRIVATE KEY-----\n"}]': finished 2024-02-22T19:03:15.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64101]: audit 2024-02-22T19:03:15.210163+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmAyE1JM9vVlFNEmwIHiZnbbDWwEtnXWvaQo/N379txO/6dCSOpgUEuYXwv4RHdQ8dJ0qhVSNqhqbUxie380q2Hd6PwCpL31+ZsQsfbFo/yVJph9Ndks+69wDfBsoZ8n47UVJ9z87npu5FYOx8w5mejPfnrmzdsvyCQedwRaOmo4MaAXPQulMrIeLFFmWfvgvFEo8SIfl/6A/9FinMznzuNTrXntVyn5+o6bqVPE5lLC4biTy74vkkcZWvLQY5RhoeZ+1MWvwDAS43OZKR9yQDrHbrEeXuQ3STqOCzB2hRHod6hPbWMwnbJuwYLk1r6i8Czq72vcTADkWyxQ8BDqeO4v22lbFIyY0JFqF687noIbIiICEQ8qpmJOE9a7sNtQSlgRi2zwal6dd+r4TfPVwdYmcKij/YMXdARva+PuYeDZWnrfam2480IjZcrH8YWYFs59Pey+Z1UB3oiSQ10KsTW0IH19jC6AbkP4ITp7mb1wkMTvqp9z/E6ODkyMmiiHM= ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715\n"}]: dispatch 2024-02-22T19:03:15.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:15 smithi062 bash[64101]: audit 2024-02-22T19:03:15.211427+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmAyE1JM9vVlFNEmwIHiZnbbDWwEtnXWvaQo/N379txO/6dCSOpgUEuYXwv4RHdQ8dJ0qhVSNqhqbUxie380q2Hd6PwCpL31+ZsQsfbFo/yVJph9Ndks+69wDfBsoZ8n47UVJ9z87npu5FYOx8w5mejPfnrmzdsvyCQedwRaOmo4MaAXPQulMrIeLFFmWfvgvFEo8SIfl/6A/9FinMznzuNTrXntVyn5+o6bqVPE5lLC4biTy74vkkcZWvLQY5RhoeZ+1MWvwDAS43OZKR9yQDrHbrEeXuQ3STqOCzB2hRHod6hPbWMwnbJuwYLk1r6i8Czq72vcTADkWyxQ8BDqeO4v22lbFIyY0JFqF687noIbIiICEQ8qpmJOE9a7sNtQSlgRi2zwal6dd+r4TfPVwdYmcKij/YMXdARva+PuYeDZWnrfam2480IjZcrH8YWYFs59Pey+Z1UB3oiSQ10KsTW0IH19jC6AbkP4ITp7mb1wkMTvqp9z/E6ODkyMmiiHM= ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715\n"}]': finished 2024-02-22T19:03:15.874 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'get-pub-key'] 2024-02-22T19:03:15.874 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm get-pub-key 2024-02-22T19:03:16.532 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmAyE1JM9vVlFNEmwIHiZnbbDWwEtnXWvaQo/N379txO/6dCSOpgUEuYXwv4RHdQ8dJ0qhVSNqhqbUxie380q2Hd6PwCpL31+ZsQsfbFo/yVJph9Ndks+69wDfBsoZ8n47UVJ9z87npu5FYOx8w5mejPfnrmzdsvyCQedwRaOmo4MaAXPQulMrIeLFFmWfvgvFEo8SIfl/6A/9FinMznzuNTrXntVyn5+o6bqVPE5lLC4biTy74vkkcZWvLQY5RhoeZ+1MWvwDAS43OZKR9yQDrHbrEeXuQ3STqOCzB2hRHod6hPbWMwnbJuwYLk1r6i8Czq72vcTADkWyxQ8BDqeO4v22lbFIyY0JFqF687noIbIiICEQ8qpmJOE9a7sNtQSlgRi2zwal6dd+r4TfPVwdYmcKij/YMXdARva+PuYeDZWnrfam2480IjZcrH8YWYFs59Pey+Z1UB3oiSQ10KsTW0IH19jC6AbkP4ITp7mb1wkMTvqp9z/E6ODkyMmiiHM= ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:03:16.928 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:16 smithi062 bash[64101]: audit 2024-02-22T19:03:14.962922+0000 mgr.y (mgr.14117) 2 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:03:16.928 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:16 smithi062 bash[64101]: cephadm 2024-02-22T19:03:14.963119+0000 mgr.y (mgr.14117) 3 : cephadm [INF] Generating ssh key... 2024-02-22T19:03:17.223 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2024-02-22T19:03:17.224 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Adding key to root@localhost's authorized_keys... 2024-02-22T19:03:17.224 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Adding host smithi062... 2024-02-22T19:03:17.224 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'host', 'add', 'smithi062'] 2024-02-22T19:03:17.224 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch host add smithi062 2024-02-22T19:03:17.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:17 smithi062 bash[64101]: audit 2024-02-22T19:03:16.531907+0000 mgr.y (mgr.14117) 4 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:03:18.484 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:18 smithi062 bash[64334]: Warning: Permanently added 'smithi062,172.21.15.62' (ECDSA) to the list of known hosts. 2024-02-22T19:03:18.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:18 smithi062 bash[64101]: audit 2024-02-22T19:03:18.538607+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"smithi062\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-22T19:03:18.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:18 smithi062 bash[64101]: audit 2024-02-22T19:03:18.540426+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"smithi062\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-22T19:03:19.006 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Added host 'smithi062' 2024-02-22T19:03:19.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:19 smithi062 bash[64101]: audit 2024-02-22T19:03:18.003105+0000 mgr.y (mgr.14117) 5 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi062", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:03:19.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:19 smithi062 bash[64101]: cephadm 2024-02-22T19:03:18.540917+0000 mgr.y (mgr.14117) 6 : cephadm [INF] Added host smithi062 2024-02-22T19:03:19.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:19 smithi062 bash[64101]: audit 2024-02-22T19:03:18.770207+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:03:19.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:19 smithi062 bash[64101]: audit 2024-02-22T19:03:18.771961+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:03:19.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:19 smithi062 bash[64101]: audit 2024-02-22T19:03:18.772424+0000 mon.a (mon.0) 63 : audit [DBG] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:03:20.200 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Enabling the dashboard module... 2024-02-22T19:03:20.200 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'dashboard'] 2024-02-22T19:03:20.200 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable dashboard 2024-02-22T19:03:21.734 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:21 smithi062 bash[64334]: ignoring --setuser ceph since I am not root 2024-02-22T19:03:21.735 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:21 smithi062 bash[64334]: ignoring --setgroup ceph since I am not root 2024-02-22T19:03:21.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:21 smithi062 bash[64101]: audit 2024-02-22T19:03:20.491841+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:03:20.490270\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:03:20.491396\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-22T19:03:20.491476\", \"networks\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:03:21.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:21 smithi062 bash[64101]: audit 2024-02-22T19:03:20.494250+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:03:20.490270\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:03:20.491396\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-22T19:03:20.491476\", \"networks\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:03:21.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:21 smithi062 bash[64101]: audit 2024-02-22T19:03:20.494686+0000 mon.a (mon.0) 66 : audit [DBG] from='mgr.14117 172.21.15.62:0/4024364894' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:03:21.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:21 smithi062 bash[64101]: audit 2024-02-22T19:03:20.980239+0000 mon.a (mon.0) 67 : audit [INF] from='client.? 172.21.15.62:0/312100047' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-22T19:03:22.285 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2024-02-22T19:03:22.286 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2024-02-22T19:03:22.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:22 smithi062 bash[64101]: audit 2024-02-22T19:03:21.495829+0000 mon.a (mon.0) 68 : audit [INF] from='client.? 172.21.15.62:0/312100047' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-22T19:03:22.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:22 smithi062 bash[64101]: cluster 2024-02-22T19:03:21.495869+0000 mon.a (mon.0) 69 : cluster [DBG] mgrmap e9: y(active, since 17s) 2024-02-22T19:03:24.493 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.493 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 9, 2024-02-22T19:03:24.494 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14117, 2024-02-22T19:03:24.494 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2024-02-22T19:03:24.494 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2024-02-22T19:03:24.494 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-22T19:03:24.494 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.494 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-22T19:03:24.494 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.62:6800", 2024-02-22T19:03:24.494 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 686951691 2024-02-22T19:03:24.494 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.494 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.494 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2024-02-22T19:03:24.494 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.62:6801", 2024-02-22T19:03:24.495 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 686951691 2024-02-22T19:03:24.495 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.495 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-22T19:03:24.495 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.495 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.15.62:6801/686951691", 2024-02-22T19:03:24.495 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2024-02-22T19:03:04.423057+0000", 2024-02-22T19:03:24.495 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2024-02-22T19:03:24.495 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2024-02-22T19:03:24.495 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2024-02-22T19:03:24.495 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2024-02-22T19:03:24.495 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2024-02-22T19:03:24.495 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "dashboard", 2024-02-22T19:03:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2024-02-22T19:03:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2024-02-22T19:03:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2024-02-22T19:03:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2024-02-22T19:03:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-22T19:03:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-22T19:03:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:24.496 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-22T19:03:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2024-02-22T19:03:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.497 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.498 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.499 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.500 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.500 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.500 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.500 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.500 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.500 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.500 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.500 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.500 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.500 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.500 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.500 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.500 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.500 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.501 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.501 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.501 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.501 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.501 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.501 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.501 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.501 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.501 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.501 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.501 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.501 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.501 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.502 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.502 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.502 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.502 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.502 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.502 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.502 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.502 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.502 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.502 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.502 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.502 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.502 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.503 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2024-02-22T19:03:24.503 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2024-02-22T19:03:24.503 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.503 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.503 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.503 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.503 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.503 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.503 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.503 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2024-02-22T19:03:24.503 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.503 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.503 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.504 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.504 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2024-02-22T19:03:24.504 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2024-02-22T19:03:24.504 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.504 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.504 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.504 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2024-02-22T19:03:24.504 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.504 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.504 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.504 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2024-02-22T19:03:24.505 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.505 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.505 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.505 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.505 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2024-02-22T19:03:24.505 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2024-02-22T19:03:24.505 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.505 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.505 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.505 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.505 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.505 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.506 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.506 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2024-02-22T19:03:24.506 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.506 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.506 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.506 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.506 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2024-02-22T19:03:24.506 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2024-02-22T19:03:24.506 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.506 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.506 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.506 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.507 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.507 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.507 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.507 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2024-02-22T19:03:24.507 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.507 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.507 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.507 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.507 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2024-02-22T19:03:24.507 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2024-02-22T19:03:24.507 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.507 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.508 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.508 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2024-02-22T19:03:24.508 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.508 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.508 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.508 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2024-02-22T19:03:24.508 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.508 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.508 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.508 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.508 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2024-02-22T19:03:24.508 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2024-02-22T19:03:24.509 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.509 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.509 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.509 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.509 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.509 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.509 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.509 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2024-02-22T19:03:24.509 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.509 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.509 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.509 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.509 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2024-02-22T19:03:24.509 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2024-02-22T19:03:24.510 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.510 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.510 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.510 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.510 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.510 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.510 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.510 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2024-02-22T19:03:24.510 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.510 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.510 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.511 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.511 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2024-02-22T19:03:24.511 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2024-02-22T19:03:24.511 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.511 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.511 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.511 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.511 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.511 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.511 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.511 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2024-02-22T19:03:24.511 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.511 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.511 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.511 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.512 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.512 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.512 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.512 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2024-02-22T19:03:24.512 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.512 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.512 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.512 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2024-02-22T19:03:24.512 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2024-02-22T19:03:24.512 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.512 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.512 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.512 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.513 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.513 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.513 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.513 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2024-02-22T19:03:24.513 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.513 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.513 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.513 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.513 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2024-02-22T19:03:24.513 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2024-02-22T19:03:24.513 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.513 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.513 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.514 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2024-02-22T19:03:24.514 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.514 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.514 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.514 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2024-02-22T19:03:24.514 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2024-02-22T19:03:24.514 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.514 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.514 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.514 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2024-02-22T19:03:24.514 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2024-02-22T19:03:24.514 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-22T19:03:24.515 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.515 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.515 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-02-22T19:03:24.515 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2024-02-22T19:03:24.515 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2024-02-22T19:03:24.515 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.515 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2024-02-22T19:03:24.515 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2024-02-22T19:03:24.515 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.515 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.515 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.515 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2024-02-22T19:03:24.515 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2024-02-22T19:03:24.516 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-22T19:03:24.516 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.516 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.516 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2024-02-22T19:03:24.516 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2024-02-22T19:03:24.516 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2024-02-22T19:03:24.516 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.516 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2024-02-22T19:03:24.516 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.516 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.516 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.516 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.516 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2024-02-22T19:03:24.517 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2024-02-22T19:03:24.517 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.517 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.517 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.517 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2024-02-22T19:03:24.517 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.517 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.517 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.517 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2024-02-22T19:03:24.517 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-02-22T19:03:24.517 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.517 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.517 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.518 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2024-02-22T19:03:24.518 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2024-02-22T19:03:24.518 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-02-22T19:03:24.518 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.518 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.518 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2024-02-22T19:03:24.518 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2024-02-22T19:03:24.518 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2024-02-22T19:03:24.518 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.518 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2024-02-22T19:03:24.518 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-02-22T19:03:24.518 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.518 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.519 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.519 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2024-02-22T19:03:24.519 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2024-02-22T19:03:24.519 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.519 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.519 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.519 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2024-02-22T19:03:24.519 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.519 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.519 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.519 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2024-02-22T19:03:24.519 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2024-02-22T19:03:24.519 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.519 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.520 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.520 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2024-02-22T19:03:24.520 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2024-02-22T19:03:24.520 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-22T19:03:24.520 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.520 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.520 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2024-02-22T19:03:24.520 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2024-02-22T19:03:24.520 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2024-02-22T19:03:24.520 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.520 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-02-22T19:03:24.520 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2024-02-22T19:03:24.521 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.521 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.521 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.521 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.521 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.521 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.521 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.521 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.521 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.521 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.521 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.521 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.521 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.521 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.522 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.522 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.522 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.522 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.522 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.522 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.522 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.522 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.522 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.522 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.522 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.522 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.522 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.523 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.523 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.523 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.523 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.523 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.523 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.523 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.523 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.523 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.523 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.523 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.523 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.523 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.524 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.524 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.524 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.524 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.524 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.524 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.524 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.524 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.524 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.524 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.524 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.524 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.524 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.524 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.525 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.525 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.525 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.525 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.525 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.525 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.525 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.525 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.525 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.525 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.525 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.525 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.526 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.526 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.526 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.526 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.526 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.526 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.526 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.526 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2024-02-22T19:03:24.526 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2024-02-22T19:03:24.526 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-02-22T19:03:24.526 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.526 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.527 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-02-22T19:03:24.527 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.527 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.527 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.527 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2024-02-22T19:03:24.527 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.527 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.527 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.527 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.527 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2024-02-22T19:03:24.527 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2024-02-22T19:03:24.527 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.527 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.527 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.528 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2024-02-22T19:03:24.528 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.528 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.528 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.528 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2024-02-22T19:03:24.528 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2024-02-22T19:03:24.528 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2024-02-22T19:03:24.528 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.528 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2024-02-22T19:03:24.528 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.528 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.528 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.529 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.529 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2024-02-22T19:03:24.529 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2024-02-22T19:03:24.529 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.529 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.529 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.529 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.529 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.529 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.529 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.529 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2024-02-22T19:03:24.530 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.530 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.530 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.530 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.530 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-22T19:03:24.530 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-22T19:03:24.530 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:24.530 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.530 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.530 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-22T19:03:24.530 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.530 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.531 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.531 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2024-02-22T19:03:24.531 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.531 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.531 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.531 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.531 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2024-02-22T19:03:24.531 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2024-02-22T19:03:24.531 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.531 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.531 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.531 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-22T19:03:24.531 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2024-02-22T19:03:24.531 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.532 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.532 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2024-02-22T19:03:24.532 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-02-22T19:03:24.532 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.532 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.532 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.532 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2024-02-22T19:03:24.532 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2024-02-22T19:03:24.532 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-22T19:03:24.532 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.532 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.532 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-22T19:03:24.533 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.533 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.533 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.533 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2024-02-22T19:03:24.533 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.533 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.533 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.533 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.533 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.533 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.533 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.533 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2024-02-22T19:03:24.533 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.533 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.533 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.534 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2024-02-22T19:03:24.534 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2024-02-22T19:03:24.534 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.534 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.534 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.534 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.534 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.534 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.534 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.534 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2024-02-22T19:03:24.534 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-02-22T19:03:24.534 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.534 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.535 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.535 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2024-02-22T19:03:24.535 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2024-02-22T19:03:24.535 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.535 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.535 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.535 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2024-02-22T19:03:24.535 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.535 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.535 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.535 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2024-02-22T19:03:24.535 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.535 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.535 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.536 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.536 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2024-02-22T19:03:24.536 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2024-02-22T19:03:24.536 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:24.536 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.536 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.536 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-22T19:03:24.536 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.536 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.536 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.536 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2024-02-22T19:03:24.536 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.537 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.537 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.537 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.537 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2024-02-22T19:03:24.537 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2024-02-22T19:03:24.537 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:24.537 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.537 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.537 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2024-02-22T19:03:24.537 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.537 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.537 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.537 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2024-02-22T19:03:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2024-02-22T19:03:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2024-02-22T19:03:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-22T19:03:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.538 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.539 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2024-02-22T19:03:24.539 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.539 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.539 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.539 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.539 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.539 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.539 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.539 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.539 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.539 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.539 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.539 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.539 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.540 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.540 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.540 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.540 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.540 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.540 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.540 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.540 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.540 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.540 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.540 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.540 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.540 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.541 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.541 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.541 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.541 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.541 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.541 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.541 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.541 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.541 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2024-02-22T19:03:24.541 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.541 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.541 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.541 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.542 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.542 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.542 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.542 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.542 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.542 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.542 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.542 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.542 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.542 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.542 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.542 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.542 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.542 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.543 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.543 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.543 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.543 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.543 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.543 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.543 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.543 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.543 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.543 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.543 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.543 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.543 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.544 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.544 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.544 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.544 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.544 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.544 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.544 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.544 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.544 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2024-02-22T19:03:24.544 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2024-02-22T19:03:24.544 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.544 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.544 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.544 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2024-02-22T19:03:24.545 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.545 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.545 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.545 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2024-02-22T19:03:24.545 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2024-02-22T19:03:24.545 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.545 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2024-02-22T19:03:24.545 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.545 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.545 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.545 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.545 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2024-02-22T19:03:24.545 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2024-02-22T19:03:24.546 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.546 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.546 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.546 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-22T19:03:24.546 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.546 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.546 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.546 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2024-02-22T19:03:24.546 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.546 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.546 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.546 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.546 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2024-02-22T19:03:24.547 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2024-02-22T19:03:24.547 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.547 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.547 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.547 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.547 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.547 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.547 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.547 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2024-02-22T19:03:24.547 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.547 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.547 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.547 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.547 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2024-02-22T19:03:24.548 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2024-02-22T19:03:24.548 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.548 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.548 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.548 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.548 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.548 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.548 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.548 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-02-22T19:03:24.548 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.548 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.548 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.549 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.549 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2024-02-22T19:03:24.549 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2024-02-22T19:03:24.549 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.549 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.549 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.549 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.549 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.549 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.549 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.549 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-02-22T19:03:24.549 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.549 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.549 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.550 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.550 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.550 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.550 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.550 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2024-02-22T19:03:24.550 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.550 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.550 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.550 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.550 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.550 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.550 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.550 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.550 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.551 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.551 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.551 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.551 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.551 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.551 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.551 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.551 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.551 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.551 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.551 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.551 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.551 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.551 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.552 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.552 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.552 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.552 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.552 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.552 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.552 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.552 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.552 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.552 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.552 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.552 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.552 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.552 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.553 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.553 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.553 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.553 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.553 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.553 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.553 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.553 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.553 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.553 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.553 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.553 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.553 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.553 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.554 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2024-02-22T19:03:24.555 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2024-02-22T19:03:24.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:24.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2024-02-22T19:03:24.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2024-02-22T19:03:24.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.556 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2024-02-22T19:03:24.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2024-02-22T19:03:24.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:24.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2024-02-22T19:03:24.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2024-02-22T19:03:24.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.557 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2024-02-22T19:03:24.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2024-02-22T19:03:24.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2024-02-22T19:03:24.558 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2024-02-22T19:03:24.559 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2024-02-22T19:03:24.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.560 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2024-02-22T19:03:24.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2024-02-22T19:03:24.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.561 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2024-02-22T19:03:24.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2024-02-22T19:03:24.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.562 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2024-02-22T19:03:24.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2024-02-22T19:03:24.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.563 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2024-02-22T19:03:24.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2024-02-22T19:03:24.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.564 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2024-02-22T19:03:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2024-02-22T19:03:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.565 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2024-02-22T19:03:24.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2024-02-22T19:03:24.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.566 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2024-02-22T19:03:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2024-02-22T19:03:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.567 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2024-02-22T19:03:24.568 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2024-02-22T19:03:24.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-02-22T19:03:24.569 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-02-22T19:03:24.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.570 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2024-02-22T19:03:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2024-02-22T19:03:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-02-22T19:03:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.571 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2024-02-22T19:03:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2024-02-22T19:03:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.572 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2024-02-22T19:03:24.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2024-02-22T19:03:24.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.573 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2024-02-22T19:03:24.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2024-02-22T19:03:24.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-02-22T19:03:24.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.574 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2024-02-22T19:03:24.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-02-22T19:03:24.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.575 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2024-02-22T19:03:24.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2024-02-22T19:03:24.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.576 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2024-02-22T19:03:24.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2024-02-22T19:03:24.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.577 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-02-22T19:03:24.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-02-22T19:03:24.578 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-02-22T19:03:24.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-02-22T19:03:24.579 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-02-22T19:03:24.580 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-02-22T19:03:24.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.581 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-02-22T19:03:24.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-02-22T19:03:24.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.582 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-02-22T19:03:24.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-02-22T19:03:24.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.583 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-02-22T19:03:24.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-02-22T19:03:24.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.584 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-02-22T19:03:24.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-02-22T19:03:24.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.585 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2024-02-22T19:03:24.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2024-02-22T19:03:24.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.586 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2024-02-22T19:03:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2024-02-22T19:03:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.587 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-02-22T19:03:24.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2024-02-22T19:03:24.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-02-22T19:03:24.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-22T19:03:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2024-02-22T19:03:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2024-02-22T19:03:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.589 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2024-02-22T19:03:24.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2024-02-22T19:03:24.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2024-02-22T19:03:24.590 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2024-02-22T19:03:24.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.591 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2024-02-22T19:03:24.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2024-02-22T19:03:24.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.592 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2024-02-22T19:03:24.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2024-02-22T19:03:24.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-02-22T19:03:24.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.593 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2024-02-22T19:03:24.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2024-02-22T19:03:24.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.594 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2024-02-22T19:03:24.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2024-02-22T19:03:24.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2024-02-22T19:03:24.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.595 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2024-02-22T19:03:24.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2024-02-22T19:03:24.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2024-02-22T19:03:24.596 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2024-02-22T19:03:24.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2024-02-22T19:03:24.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.597 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2024-02-22T19:03:24.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2024-02-22T19:03:24.598 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2024-02-22T19:03:24.599 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2024-02-22T19:03:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.600 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2024-02-22T19:03:24.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2024-02-22T19:03:24.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-02-22T19:03:24.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.601 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2024-02-22T19:03:24.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-02-22T19:03:24.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-22T19:03:24.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.602 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2024-02-22T19:03:24.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-02-22T19:03:24.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-22T19:03:24.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.603 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2024-02-22T19:03:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2024-02-22T19:03:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.604 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2024-02-22T19:03:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2024-02-22T19:03:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.605 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2024-02-22T19:03:24.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2024-02-22T19:03:24.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2024-02-22T19:03:24.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.606 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2024-02-22T19:03:24.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2024-02-22T19:03:24.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2024-02-22T19:03:24.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.607 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.608 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.609 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.610 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.611 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.612 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.613 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2024-02-22T19:03:24.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2024-02-22T19:03:24.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.614 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-02-22T19:03:24.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-02-22T19:03:24.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2024-02-22T19:03:24.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.615 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-02-22T19:03:24.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-02-22T19:03:24.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2024-02-22T19:03:24.616 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2024-02-22T19:03:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2024-02-22T19:03:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.617 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2024-02-22T19:03:24.618 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2024-02-22T19:03:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2024-02-22T19:03:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.619 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2024-02-22T19:03:24.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2024-02-22T19:03:24.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2024-02-22T19:03:24.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2024-02-22T19:03:24.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.620 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2024-02-22T19:03:24.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2024-02-22T19:03:24.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2024-02-22T19:03:24.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2024-02-22T19:03:24.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2024-02-22T19:03:24.621 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2024-02-22T19:03:24.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2024-02-22T19:03:24.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.622 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2024-02-22T19:03:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2024-02-22T19:03:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.623 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.624 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2024-02-22T19:03:24.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2024-02-22T19:03:24.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2024-02-22T19:03:24.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.625 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2024-02-22T19:03:24.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.626 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.627 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.628 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.629 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.630 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.631 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2024-02-22T19:03:24.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2024-02-22T19:03:24.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:24.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2024-02-22T19:03:24.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.632 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2024-02-22T19:03:24.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2024-02-22T19:03:24.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2024-02-22T19:03:24.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2024-02-22T19:03:24.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.633 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2024-02-22T19:03:24.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2024-02-22T19:03:24.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2024-02-22T19:03:24.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:24.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.634 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2024-02-22T19:03:24.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2024-02-22T19:03:24.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2024-02-22T19:03:24.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2024-02-22T19:03:24.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:24.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.635 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2024-02-22T19:03:24.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2024-02-22T19:03:24.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2024-02-22T19:03:24.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2024-02-22T19:03:24.636 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2024-02-22T19:03:24.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.637 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-22T19:03:24.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-22T19:03:24.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:24.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-22T19:03:24.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2024-02-22T19:03:24.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.638 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2024-02-22T19:03:24.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2024-02-22T19:03:24.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:24.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2024-02-22T19:03:24.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2024-02-22T19:03:24.639 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2024-02-22T19:03:24.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.640 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.641 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.642 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.643 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.644 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.645 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.646 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2024-02-22T19:03:24.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2024-02-22T19:03:24.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2024-02-22T19:03:24.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.647 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2024-02-22T19:03:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2024-02-22T19:03:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2024-02-22T19:03:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.648 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-22T19:03:24.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-22T19:03:24.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.649 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-22T19:03:24.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.650 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2024-02-22T19:03:24.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2024-02-22T19:03:24.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2024-02-22T19:03:24.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2024-02-22T19:03:24.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2024-02-22T19:03:24.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2024-02-22T19:03:24.651 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2024-02-22T19:03:24.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2024-02-22T19:03:24.652 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2024-02-22T19:03:24.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2024-02-22T19:03:24.653 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2024-02-22T19:03:24.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-22T19:03:24.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.654 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-22T19:03:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-22T19:03:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2024-02-22T19:03:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.655 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.656 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.657 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.658 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.660 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.661 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2024-02-22T19:03:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2024-02-22T19:03:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-22T19:03:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.662 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2024-02-22T19:03:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2024-02-22T19:03:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2024-02-22T19:03:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.663 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2024-02-22T19:03:24.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2024-02-22T19:03:24.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2024-02-22T19:03:24.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.664 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2024-02-22T19:03:24.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2024-02-22T19:03:24.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-22T19:03:24.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.665 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2024-02-22T19:03:24.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2024-02-22T19:03:24.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-22T19:03:24.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.666 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2024-02-22T19:03:24.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2024-02-22T19:03:24.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2024-02-22T19:03:24.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.667 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2024-02-22T19:03:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.669 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.670 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.671 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.672 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.673 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2024-02-22T19:03:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.674 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.675 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.676 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.677 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.678 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.679 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2024-02-22T19:03:24.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2024-02-22T19:03:24.680 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2024-02-22T19:03:24.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2024-02-22T19:03:24.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2024-02-22T19:03:24.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.681 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2024-02-22T19:03:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2024-02-22T19:03:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-22T19:03:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2024-02-22T19:03:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2024-02-22T19:03:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.683 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.684 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.685 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.686 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.687 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2024-02-22T19:03:24.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.688 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2024-02-22T19:03:24.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2024-02-22T19:03:24.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2024-02-22T19:03:24.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2024-02-22T19:03:24.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.689 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.690 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.691 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.692 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.693 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.694 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2024-02-22T19:03:24.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2024-02-22T19:03:24.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.695 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2024-02-22T19:03:24.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2024-02-22T19:03:24.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2024-02-22T19:03:24.696 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2024-02-22T19:03:24.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2024-02-22T19:03:24.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.697 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2024-02-22T19:03:24.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2024-02-22T19:03:24.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2024-02-22T19:03:24.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2024-02-22T19:03:24.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.698 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2024-02-22T19:03:24.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2024-02-22T19:03:24.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.699 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2024-02-22T19:03:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2024-02-22T19:03:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2024-02-22T19:03:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2024-02-22T19:03:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2024-02-22T19:03:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2024-02-22T19:03:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.704 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.705 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.706 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2024-02-22T19:03:24.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2024-02-22T19:03:24.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.707 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-22T19:03:24.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2024-02-22T19:03:24.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2024-02-22T19:03:24.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2024-02-22T19:03:24.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2024-02-22T19:03:24.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.708 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2024-02-22T19:03:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.709 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.711 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.712 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.713 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.714 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2024-02-22T19:03:24.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.715 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.716 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.717 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.718 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.719 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-22T19:03:24.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-22T19:03:24.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-22T19:03:24.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.721 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2024-02-22T19:03:24.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.722 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.723 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.724 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.725 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.726 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.727 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2024-02-22T19:03:24.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2024-02-22T19:03:24.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2024-02-22T19:03:24.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.728 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2024-02-22T19:03:24.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2024-02-22T19:03:24.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2024-02-22T19:03:24.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:24.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-22T19:03:24.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.729 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2024-02-22T19:03:24.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2024-02-22T19:03:24.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.730 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.731 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.732 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.733 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.734 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.735 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2024-02-22T19:03:24.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2024-02-22T19:03:24.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.736 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2024-02-22T19:03:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2024-02-22T19:03:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.737 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2024-02-22T19:03:24.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2024-02-22T19:03:24.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.738 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-02-22T19:03:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-02-22T19:03:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.739 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-02-22T19:03:24.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-02-22T19:03:24.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.740 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2024-02-22T19:03:24.741 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.742 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.743 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.744 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.745 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.746 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2024-02-22T19:03:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2024-02-22T19:03:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2024-02-22T19:03:24.748 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2024-02-22T19:03:24.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.749 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2024-02-22T19:03:24.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2024-02-22T19:03:24.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2024-02-22T19:03:24.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.750 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.751 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.752 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.753 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.754 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.755 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.756 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-02-22T19:03:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-02-22T19:03:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-02-22T19:03:24.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-02-22T19:03:24.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.758 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2024-02-22T19:03:24.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.759 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.761 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.764 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2024-02-22T19:03:24.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.765 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.767 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.768 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.769 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.770 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2024-02-22T19:03:24.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2024-02-22T19:03:24.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.771 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2024-02-22T19:03:24.772 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2024-02-22T19:03:24.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2024-02-22T19:03:24.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.773 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2024-02-22T19:03:24.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2024-02-22T19:03:24.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.774 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2024-02-22T19:03:24.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2024-02-22T19:03:24.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.775 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2024-02-22T19:03:24.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2024-02-22T19:03:24.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-02-22T19:03:24.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.776 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2024-02-22T19:03:24.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2024-02-22T19:03:24.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.777 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2024-02-22T19:03:24.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2024-02-22T19:03:24.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.778 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2024-02-22T19:03:24.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2024-02-22T19:03:24.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.779 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2024-02-22T19:03:24.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2024-02-22T19:03:24.780 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.781 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2024-02-22T19:03:24.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2024-02-22T19:03:24.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.782 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2024-02-22T19:03:24.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2024-02-22T19:03:24.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.783 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2024-02-22T19:03:24.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.784 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.785 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.787 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.788 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2024-02-22T19:03:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.790 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2024-02-22T19:03:24.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2024-02-22T19:03:24.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2024-02-22T19:03:24.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.791 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-22T19:03:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-22T19:03:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2024-02-22T19:03:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.793 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.796 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.798 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2024-02-22T19:03:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2024-02-22T19:03:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2024-02-22T19:03:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.799 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2024-02-22T19:03:24.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2024-02-22T19:03:24.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2024-02-22T19:03:24.800 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2024-02-22T19:03:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2024-02-22T19:03:24.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-22T19:03:24.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.802 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2024-02-22T19:03:24.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2024-02-22T19:03:24.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.803 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2024-02-22T19:03:24.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2024-02-22T19:03:24.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-22T19:03:24.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.804 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2024-02-22T19:03:24.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2024-02-22T19:03:24.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-22T19:03:24.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.805 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2024-02-22T19:03:24.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2024-02-22T19:03:24.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2024-02-22T19:03:24.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.806 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2024-02-22T19:03:24.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2024-02-22T19:03:24.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.807 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-22T19:03:24.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-22T19:03:24.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.808 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2024-02-22T19:03:24.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2024-02-22T19:03:24.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2024-02-22T19:03:24.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2024-02-22T19:03:24.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.809 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2024-02-22T19:03:24.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2024-02-22T19:03:24.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2024-02-22T19:03:24.810 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.813 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.816 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.817 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.817 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.817 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.817 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.817 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.817 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2024-02-22T19:03:24.817 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2024-02-22T19:03:24.817 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.817 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.817 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.817 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-22T19:03:24.817 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.817 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.818 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.818 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.818 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.818 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.818 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.818 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.818 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2024-02-22T19:03:24.818 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2024-02-22T19:03:24.818 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.818 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.818 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.818 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-22T19:03:24.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2024-02-22T19:03:24.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2024-02-22T19:03:24.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.819 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2024-02-22T19:03:24.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.820 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2024-02-22T19:03:24.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.821 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.826 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2024-02-22T19:03:24.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.827 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.828 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.829 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.831 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2024-02-22T19:03:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-22T19:03:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-22T19:03:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-22T19:03:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2024-02-22T19:03:24.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2024-02-22T19:03:24.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2024-02-22T19:03:24.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.834 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2024-02-22T19:03:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2024-02-22T19:03:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-22T19:03:24.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-22T19:03:24.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-22T19:03:24.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-22T19:03:24.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.836 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-22T19:03:24.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-22T19:03:24.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-22T19:03:24.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.837 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-22T19:03:24.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-22T19:03:24.838 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-22T19:03:24.839 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-22T19:03:24.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-22T19:03:24.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-22T19:03:24.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-22T19:03:24.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-22T19:03:24.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-22T19:03:24.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-22T19:03:24.840 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-22T19:03:24.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-22T19:03:24.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-22T19:03:24.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-22T19:03:24.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-22T19:03:24.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.841 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-22T19:03:24.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-22T19:03:24.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2024-02-22T19:03:24.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2024-02-22T19:03:24.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.842 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-22T19:03:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2024-02-22T19:03:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2024-02-22T19:03:24.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-22T19:03:24.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2024-02-22T19:03:24.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.844 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2024-02-22T19:03:24.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2024-02-22T19:03:24.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-22T19:03:24.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-22T19:03:24.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-22T19:03:24.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2024-02-22T19:03:24.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-22T19:03:24.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-22T19:03:24.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-22T19:03:24.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-22T19:03:24.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-22T19:03:24.845 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-22T19:03:24.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-22T19:03:24.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2024-02-22T19:03:24.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2024-02-22T19:03:24.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2024-02-22T19:03:24.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2024-02-22T19:03:24.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2024-02-22T19:03:24.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2024-02-22T19:03:24.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2024-02-22T19:03:24.846 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2024-02-22T19:03:24.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2024-02-22T19:03:24.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2024-02-22T19:03:24.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2024-02-22T19:03:24.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2024-02-22T19:03:24.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2024-02-22T19:03:24.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2024-02-22T19:03:24.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2024-02-22T19:03:24.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2024-02-22T19:03:24.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2024-02-22T19:03:24.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2024-02-22T19:03:24.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2024-02-22T19:03:24.847 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2024-02-22T19:03:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2024-02-22T19:03:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2024-02-22T19:03:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2024-02-22T19:03:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-22T19:03:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 4, 2024-02-22T19:03:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2024-02-22T19:03:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-22T19:03:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-22T19:03:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.62:0", 2024-02-22T19:03:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1695667212 2024-02-22T19:03:24.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-22T19:03:24.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-22T19:03:24.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-22T19:03:24.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.62:0", 2024-02-22T19:03:24.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 3545899632 2024-02-22T19:03:24.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-22T19:03:24.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-22T19:03:24.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.849 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-22T19:03:24.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:24.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-22T19:03:24.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.62:0", 2024-02-22T19:03:24.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2030480752 2024-02-22T19:03:24.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-22T19:03:24.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-22T19:03:24.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.850 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:24.850 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:24 smithi062 bash[64101]: audit 2024-02-22T19:03:24.054000+0000 mon.a (mon.0) 70 : audit [DBG] from='client.? 172.21.15.62:0/3525401028' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2024-02-22T19:03:25.587 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Waiting for the mgr to restart... 2024-02-22T19:03:25.588 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Waiting for Mgr epoch 9... 2024-02-22T19:03:25.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2024-02-22T19:03:25.588 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2024-02-22T19:03:25.734 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:25 smithi062 bash[64334]: Warning: Permanently added 'smithi062,172.21.15.62' (ECDSA) to the list of known hosts. 2024-02-22T19:03:25.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:25 smithi062 bash[64101]: cluster 2024-02-22T19:03:25.373469+0000 mon.a (mon.0) 71 : cluster [INF] Active manager daemon y restarted 2024-02-22T19:03:25.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:25 smithi062 bash[64101]: cluster 2024-02-22T19:03:25.373902+0000 mon.a (mon.0) 72 : cluster [INF] Activating manager daemon y 2024-02-22T19:03:25.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:25 smithi062 bash[64101]: cluster 2024-02-22T19:03:25.376026+0000 mon.a (mon.0) 73 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-02-22T19:03:26.440 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-22T19:03:26.440 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 11, 2024-02-22T19:03:26.441 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2024-02-22T19:03:26.441 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-22T19:03:26.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:26 smithi062 bash[64101]: cluster 2024-02-22T19:03:25.426992+0000 mon.a (mon.0) 74 : cluster [DBG] mgrmap e10: y(active, starting, since 0.0531611s) 2024-02-22T19:03:26.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:26 smithi062 bash[64101]: audit 2024-02-22T19:03:25.429660+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T19:03:26.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:26 smithi062 bash[64101]: audit 2024-02-22T19:03:25.429864+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T19:03:26.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:26 smithi062 bash[64101]: audit 2024-02-22T19:03:25.429992+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T19:03:26.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:26 smithi062 bash[64101]: audit 2024-02-22T19:03:25.430110+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T19:03:26.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:26 smithi062 bash[64101]: audit 2024-02-22T19:03:25.430367+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T19:03:26.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:26 smithi062 bash[64101]: audit 2024-02-22T19:03:25.430869+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi062"}]: dispatch 2024-02-22T19:03:26.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:26 smithi062 bash[64101]: audit 2024-02-22T19:03:25.431079+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T19:03:26.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:26 smithi062 bash[64101]: audit 2024-02-22T19:03:25.431260+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T19:03:26.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:26 smithi062 bash[64101]: audit 2024-02-22T19:03:25.431442+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T19:03:26.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:26 smithi062 bash[64101]: audit 2024-02-22T19:03:25.431623+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T19:03:26.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:26 smithi062 bash[64101]: audit 2024-02-22T19:03:25.431809+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T19:03:26.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:26 smithi062 bash[64101]: cluster 2024-02-22T19:03:25.444835+0000 mon.a (mon.0) 86 : cluster [INF] Manager daemon y is now available 2024-02-22T19:03:26.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:26 smithi062 bash[64101]: audit 2024-02-22T19:03:25.476194+0000 mon.a (mon.0) 87 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-22T19:03:26.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:26 smithi062 bash[64101]: audit 2024-02-22T19:03:26.361446+0000 mon.a (mon.0) 88 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-22T19:03:26.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:26 smithi062 bash[64101]: audit 2024-02-22T19:03:26.361783+0000 mon.a (mon.0) 89 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:03:27.487 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Generating a dashboard self-signed certificate... 2024-02-22T19:03:27.487 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'create-self-signed-cert'] 2024-02-22T19:03:27.487 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard create-self-signed-cert 2024-02-22T19:03:27.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:27 smithi062 bash[64101]: cluster 2024-02-22T19:03:26.431931+0000 mon.a (mon.0) 90 : cluster [DBG] mgrmap e11: y(active, since 1.0581s) 2024-02-22T19:03:28.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:28 smithi062 bash[64101]: cluster 2024-02-22T19:03:27.437688+0000 mon.a (mon.0) 91 : cluster [DBG] mgrmap e12: y(active, since 2s) 2024-02-22T19:03:28.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:28 smithi062 bash[64101]: audit 2024-02-22T19:03:28.291231+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:03:28.290563\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:03:28.290682\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-22T19:03:28.290771\", \"networks\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:03:28.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:28 smithi062 bash[64101]: audit 2024-02-22T19:03:28.293135+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:03:28.290563\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:03:28.290682\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-22T19:03:28.290771\", \"networks\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:03:28.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:28 smithi062 bash[64101]: audit 2024-02-22T19:03:28.293606+0000 mon.a (mon.0) 94 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:03:28.720 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Self-signed certificate created 2024-02-22T19:03:29.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:29 smithi062 bash[64101]: audit 2024-02-22T19:03:28.714448+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIICzzCCAbcCEDhopRxZoUACqJE+iJ7w38owDQYJKoZIhvcNAQENBQAwJjELMAkG\nA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgtZGFzaGJvYXJkMB4XDTI0MDIyMjE5MDMy\nOFoXDTM0MDIxOTE5MDMyOFowJjELMAkGA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgt\nZGFzaGJvYXJkMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA6loMZfIG\nGtYcCLgMsXnZmHKyaJwMcc+QFMg9aymKOCnKggdx0d9sIfGpFqzL5wfjQutTRnGn\nkSx4AhaPx1Rm4bonBH6XhXu4BpKrvo0vtzjNuEUK+hvmkKfDtcZvSVd1d4btff8a\nsuRZ7p4JY1g/E5G3YE2kWIW/rb4BTrej8X53YfvXSX+v54LsktoP5hCmqmRm5+HV\nJvWwVq74cK+nUAeT07pQfUWuOLiJzLEtH9B5m7vLw7v9wtbNLV80SU+vxaJ6zq9s\ni+UaVW28IjFMUoA2qISARA+qoHbrCuJgpYFLCn0qbkkWhpckRwQ0R01ulLJkkQWE\nPyLT+OywBEDKDwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQAZeaHc6rF91Ra4KNRt\nJWoBkHJKplYAtbiCOmLUmQB+cFdSoaazSB8DIwjuOLzsOvPGtKltyA8r57cvlNCz\ndHdOXoKMGpzBz5f1W6OB1XJr0PIkG4BuPl9RGEbd+7fUyPaFrehu8PQ5UhFR0C9V\nFf/b4cUGdUqtZVNvS5zY7kV6iathV8MwZKJ8z6GqosNycXRgvT29NGTGXp3LgUwT\nsomG42AZtjxM6klzGPZSfLHilJePvHOGW8WTnZMlywlfk8i8m7H8ig6AJoS2293l\nJ7rjVXIgeDFEXNPhVPsvTW9pCQ74TYpnid54FYmyU9gHrMpekQ7KeKSMcZ8Q27Lj\nz5ro\n-----END CERTIFICATE-----\n"}]: dispatch 2024-02-22T19:03:29.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:29 smithi062 bash[64101]: audit 2024-02-22T19:03:28.716897+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIICzzCCAbcCEDhopRxZoUACqJE+iJ7w38owDQYJKoZIhvcNAQENBQAwJjELMAkG\nA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgtZGFzaGJvYXJkMB4XDTI0MDIyMjE5MDMy\nOFoXDTM0MDIxOTE5MDMyOFowJjELMAkGA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgt\nZGFzaGJvYXJkMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA6loMZfIG\nGtYcCLgMsXnZmHKyaJwMcc+QFMg9aymKOCnKggdx0d9sIfGpFqzL5wfjQutTRnGn\nkSx4AhaPx1Rm4bonBH6XhXu4BpKrvo0vtzjNuEUK+hvmkKfDtcZvSVd1d4btff8a\nsuRZ7p4JY1g/E5G3YE2kWIW/rb4BTrej8X53YfvXSX+v54LsktoP5hCmqmRm5+HV\nJvWwVq74cK+nUAeT07pQfUWuOLiJzLEtH9B5m7vLw7v9wtbNLV80SU+vxaJ6zq9s\ni+UaVW28IjFMUoA2qISARA+qoHbrCuJgpYFLCn0qbkkWhpckRwQ0R01ulLJkkQWE\nPyLT+OywBEDKDwIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQAZeaHc6rF91Ra4KNRt\nJWoBkHJKplYAtbiCOmLUmQB+cFdSoaazSB8DIwjuOLzsOvPGtKltyA8r57cvlNCz\ndHdOXoKMGpzBz5f1W6OB1XJr0PIkG4BuPl9RGEbd+7fUyPaFrehu8PQ5UhFR0C9V\nFf/b4cUGdUqtZVNvS5zY7kV6iathV8MwZKJ8z6GqosNycXRgvT29NGTGXp3LgUwT\nsomG42AZtjxM6klzGPZSfLHilJePvHOGW8WTnZMlywlfk8i8m7H8ig6AJoS2293l\nJ7rjVXIgeDFEXNPhVPsvTW9pCQ74TYpnid54FYmyU9gHrMpekQ7KeKSMcZ8Q27Lj\nz5ro\n-----END CERTIFICATE-----\n"}]': finished 2024-02-22T19:03:29.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:29 smithi062 bash[64101]: audit 2024-02-22T19:03:28.717278+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQDqWgxl8gYa1hwI\nuAyxedmYcrJonAxxz5AUyD1rKYo4KcqCB3HR32wh8akWrMvnB+NC61NGcaeRLHgC\nFo/HVGbhuicEfpeFe7gGkqu+jS+3OM24RQr6G+aQp8O1xm9JV3V3hu19/xqy5Fnu\nngljWD8TkbdgTaRYhb+tvgFOt6Pxfndh+9dJf6/nguyS2g/mEKaqZGbn4dUm9bBW\nrvhwr6dQB5PTulB9Ra44uInMsS0f0Hmbu8vDu/3C1s0tXzRJT6/FonrOr2yL5RpV\nbbwiMUxSgDaohIBED6qgdusK4mClgUsKfSpuSRaGlyRHBDRHTW6UsmSRBYQ/ItP4\n7LAEQMoPAgMBAAECggEBAKIUcWq4frxkxLLLCAxe571l5jovYvP7x/x3mPLaofvB\n+4r+txud2F2Jk5ZZIBTDAcywkMGxrWDcTouzKvGDUDxh0MZs/0KUlGwHWLzLTOr9\nYFpHdhYQ4d++B79aZHFnCZkHOo3ft4luITzFFF0fFVDlgNwcFsQajL0PIjxdCgfk\nSsKF348K95yys7Xg9nVMHoOCh+p/xsDpzyiZYiza2PbMMNKr2igq8T1+TrMLhcOr\nHFVGqn0Y7xJCRnK96SGG0nxWpf/VlcE3YUgfwHVaUGVzt8ZfIs/w5eTkEMoVojVw\nmyYjIIb/glrGhrBAYdgWUj7prMwu1xeIvuFrBcKlfBECgYEA9SeIxS++71pdVy/y\n639Q71qr68t7kZHcfz82wcIoUJa9Tn3cfEDJewRkZQJRH3bgBWWbh2q8XOSKhMxy\nGbI/OlB9pzIT+sY3iknM7ldieSItF5QnkP/ztURQoxXdSj5qjqNfLNoBOh2auL4w\nk6/w25CZ8V6+fPTmUUo9Lwb2/GsCgYEA9LgrdxqQMs/NapgRsS5mxdn0WkdzNp9A\nEm6jKAp16P86ZBEasr5h310KtSrrnxmLKce/arin5zOTI2DvegtEFMqot1XUQ+2/\n5KekUy4G8dMfB2Q1e4WPPuubty0XLpTMhKz7I4hrdUmuEwyIBeQA8I/iHj2Ko4iL\ntDm3cxYCEe0CgYEAmQNw+WqAqRJk2gtiepx/nrWgQs9BtC0vS/jfq3YNBafgRoKG\nQMOLPg4Sv3z/tzzSPGwb9Bypru0yjAqzWNiJYFNm6hl2oPphJh5EG6tNGkA7ltDx\nFS68JTKbhf8anMFybs8Hk44KYASkUpTa6wNQuSp6+01gZcvRiYFlyNl3BTsCgYEA\npdKF4VbmjwewMaKJmn3OthJSOTphH4oZaGP/uoocC52me1f7t1K6DxiEwO4sasps\nOgtX8YDehRO1iCuPGiu4Hj6UxGYsRzs65D2UY6i0m/hq9h84/lIqFoCgKycqpi29\nx8lPA2zVI8yhX9cF9Lfiyx80ITmiT92ejKjvXdRz4qECgYBlXtjqkq76VhsiGig6\nSDel0q4UVBuJqjwxb8BSE3jc5Aw9PrYc9RKgVtc+d+WGCyxlBa57LZQFiaT+XHv2\n8y/tHazW6b7kYpH+dkXgwVwilHMHWe+wpn5eV4AmIrQUmYzdo3wcVWwK45vvgqk0\naYFIUJfuKeVrxberzzyFOT7MYQ==\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-02-22T19:03:29.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:29 smithi062 bash[64101]: audit 2024-02-22T19:03:28.719266+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvwIBADANBgkqhkiG9w0BAQEFAASCBKkwggSlAgEAAoIBAQDqWgxl8gYa1hwI\nuAyxedmYcrJonAxxz5AUyD1rKYo4KcqCB3HR32wh8akWrMvnB+NC61NGcaeRLHgC\nFo/HVGbhuicEfpeFe7gGkqu+jS+3OM24RQr6G+aQp8O1xm9JV3V3hu19/xqy5Fnu\nngljWD8TkbdgTaRYhb+tvgFOt6Pxfndh+9dJf6/nguyS2g/mEKaqZGbn4dUm9bBW\nrvhwr6dQB5PTulB9Ra44uInMsS0f0Hmbu8vDu/3C1s0tXzRJT6/FonrOr2yL5RpV\nbbwiMUxSgDaohIBED6qgdusK4mClgUsKfSpuSRaGlyRHBDRHTW6UsmSRBYQ/ItP4\n7LAEQMoPAgMBAAECggEBAKIUcWq4frxkxLLLCAxe571l5jovYvP7x/x3mPLaofvB\n+4r+txud2F2Jk5ZZIBTDAcywkMGxrWDcTouzKvGDUDxh0MZs/0KUlGwHWLzLTOr9\nYFpHdhYQ4d++B79aZHFnCZkHOo3ft4luITzFFF0fFVDlgNwcFsQajL0PIjxdCgfk\nSsKF348K95yys7Xg9nVMHoOCh+p/xsDpzyiZYiza2PbMMNKr2igq8T1+TrMLhcOr\nHFVGqn0Y7xJCRnK96SGG0nxWpf/VlcE3YUgfwHVaUGVzt8ZfIs/w5eTkEMoVojVw\nmyYjIIb/glrGhrBAYdgWUj7prMwu1xeIvuFrBcKlfBECgYEA9SeIxS++71pdVy/y\n639Q71qr68t7kZHcfz82wcIoUJa9Tn3cfEDJewRkZQJRH3bgBWWbh2q8XOSKhMxy\nGbI/OlB9pzIT+sY3iknM7ldieSItF5QnkP/ztURQoxXdSj5qjqNfLNoBOh2auL4w\nk6/w25CZ8V6+fPTmUUo9Lwb2/GsCgYEA9LgrdxqQMs/NapgRsS5mxdn0WkdzNp9A\nEm6jKAp16P86ZBEasr5h310KtSrrnxmLKce/arin5zOTI2DvegtEFMqot1XUQ+2/\n5KekUy4G8dMfB2Q1e4WPPuubty0XLpTMhKz7I4hrdUmuEwyIBeQA8I/iHj2Ko4iL\ntDm3cxYCEe0CgYEAmQNw+WqAqRJk2gtiepx/nrWgQs9BtC0vS/jfq3YNBafgRoKG\nQMOLPg4Sv3z/tzzSPGwb9Bypru0yjAqzWNiJYFNm6hl2oPphJh5EG6tNGkA7ltDx\nFS68JTKbhf8anMFybs8Hk44KYASkUpTa6wNQuSp6+01gZcvRiYFlyNl3BTsCgYEA\npdKF4VbmjwewMaKJmn3OthJSOTphH4oZaGP/uoocC52me1f7t1K6DxiEwO4sasps\nOgtX8YDehRO1iCuPGiu4Hj6UxGYsRzs65D2UY6i0m/hq9h84/lIqFoCgKycqpi29\nx8lPA2zVI8yhX9cF9Lfiyx80ITmiT92ejKjvXdRz4qECgYBlXtjqkq76VhsiGig6\nSDel0q4UVBuJqjwxb8BSE3jc5Aw9PrYc9RKgVtc+d+WGCyxlBa57LZQFiaT+XHv2\n8y/tHazW6b7kYpH+dkXgwVwilHMHWe+wpn5eV4AmIrQUmYzdo3wcVWwK45vvgqk0\naYFIUJfuKeVrxberzzyFOT7MYQ==\n-----END PRIVATE KEY-----\n"}]': finished 2024-02-22T19:03:30.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:30 smithi062 bash[64101]: audit 2024-02-22T19:03:28.655686+0000 mgr.y (mgr.14140) 1 : audit [DBG] from='client.14153 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:03:30.853 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Creating initial admin user... 2024-02-22T19:03:30.854 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'ac-user-create', 'admin', 'zl2ys8j09t', 'administrator', '--force-password', '--pwd-update-required'] 2024-02-22T19:03:30.854 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard ac-user-create admin zl2ys8j09t administrator --force-password --pwd-update-required 2024-02-22T19:03:32.059 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout {"username": "admin", "password": "$2b$12$jWeacOIem9BjhpfdOJvRB.crR1R7IlwVARzTxfBQBnVnN6St5chku", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1708628612, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-22T19:03:32.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:32 smithi062 bash[64101]: cluster 2024-02-22T19:03:31.441515+0000 mon.a (mon.0) 99 : cluster [DBG] mgrmap e13: y(active, since 6s) 2024-02-22T19:03:32.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:32 smithi062 bash[64101]: audit 2024-02-22T19:03:32.056086+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$jWeacOIem9BjhpfdOJvRB.crR1R7IlwVARzTxfBQBnVnN6St5chku\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1708628612, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]: dispatch 2024-02-22T19:03:32.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:32 smithi062 bash[64101]: audit 2024-02-22T19:03:32.057896+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$jWeacOIem9BjhpfdOJvRB.crR1R7IlwVARzTxfBQBnVnN6St5chku\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1708628612, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]': finished 2024-02-22T19:03:32.883 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Fetching dashboard port number... 2024-02-22T19:03:32.883 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi062', '-v', '/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'get', 'mgr', 'mgr/dashboard/ssl_server_port'] 2024-02-22T19:03:32.883 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi062 -v /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpzlfarn13:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpzgdi1tjf:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config get mgr mgr/dashboard/ssl_server_port 2024-02-22T19:03:33.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:33 smithi062 bash[64101]: audit 2024-02-22T19:03:31.813365+0000 mgr.y (mgr.14140) 2 : audit [DBG] from='client.14155 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "password": "zl2ys8j09t", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:03:34.036 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 8443 2024-02-22T19:03:34.658 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Ceph Dashboard is now available at: 2024-02-22T19:03:34.658 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-22T19:03:34.658 INFO:teuthology.orchestra.run.smithi062.stderr: URL: https://smithi062.front.sepia.ceph.com:8443/ 2024-02-22T19:03:34.658 INFO:teuthology.orchestra.run.smithi062.stderr: User: admin 2024-02-22T19:03:34.658 INFO:teuthology.orchestra.run.smithi062.stderr: Password: zl2ys8j09t 2024-02-22T19:03:34.658 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-22T19:03:34.658 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:You can access the Ceph CLI with: 2024-02-22T19:03:34.658 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-22T19:03:34.658 INFO:teuthology.orchestra.run.smithi062.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-22T19:03:34.659 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-22T19:03:34.659 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Please consider enabling telemetry to help improve Ceph: 2024-02-22T19:03:34.659 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-22T19:03:34.659 INFO:teuthology.orchestra.run.smithi062.stderr: ceph telemetry on 2024-02-22T19:03:34.659 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-22T19:03:34.659 INFO:teuthology.orchestra.run.smithi062.stderr:For more information see: 2024-02-22T19:03:34.659 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-22T19:03:34.659 INFO:teuthology.orchestra.run.smithi062.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-02-22T19:03:34.659 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-22T19:03:34.659 INFO:teuthology.orchestra.run.smithi062.stderr:INFO:cephadm:Bootstrap complete. 2024-02-22T19:03:34.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Releasing lock 140113678342296 on /run/cephadm/e2bc0d14-d1b4-11ee-95bf-87774f69a715.lock 2024-02-22T19:03:34.659 INFO:teuthology.orchestra.run.smithi062.stderr:DEBUG:cephadm:Lock 140113678342296 released on /run/cephadm/e2bc0d14-d1b4-11ee-95bf-87774f69a715.lock 2024-02-22T19:03:34.660 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:34 smithi062 bash[64101]: audit 2024-02-22T19:03:33.600720+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:03:34.660 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:34 smithi062 bash[64101]: audit 2024-02-22T19:03:33.819943+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:03:28.290563\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:03:28.290682\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-22T19:03:28.290771\", \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:03:34.660 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:34 smithi062 bash[64101]: audit 2024-02-22T19:03:33.821839+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:03:28.290563\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:03:28.290682\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-22T19:03:28.290771\", \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:03:34.660 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:34 smithi062 bash[64101]: audit 2024-02-22T19:03:34.035011+0000 mon.a (mon.0) 105 : audit [DBG] from='client.? 172.21.15.62:0/4194227841' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-22T19:03:34.684 INFO:tasks.cephadm:Fetching config... 2024-02-22T19:03:34.685 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-22T19:03:34.685 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-22T19:03:34.704 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-22T19:03:34.704 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-22T19:03:34.704 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-22T19:03:34.762 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-22T19:03:34.763 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-22T19:03:34.763 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/mon.a/keyring of=/dev/stdout 2024-02-22T19:03:34.830 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-22T19:03:34.831 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-22T19:03:34.831 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-22T19:03:34.889 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-22T19:03:34.889 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmAyE1JM9vVlFNEmwIHiZnbbDWwEtnXWvaQo/N379txO/6dCSOpgUEuYXwv4RHdQ8dJ0qhVSNqhqbUxie380q2Hd6PwCpL31+ZsQsfbFo/yVJph9Ndks+69wDfBsoZ8n47UVJ9z87npu5FYOx8w5mejPfnrmzdsvyCQedwRaOmo4MaAXPQulMrIeLFFmWfvgvFEo8SIfl/6A/9FinMznzuNTrXntVyn5+o6bqVPE5lLC4biTy74vkkcZWvLQY5RhoeZ+1MWvwDAS43OZKR9yQDrHbrEeXuQ3STqOCzB2hRHod6hPbWMwnbJuwYLk1r6i8Czq72vcTADkWyxQ8BDqeO4v22lbFIyY0JFqF687noIbIiICEQ8qpmJOE9a7sNtQSlgRi2zwal6dd+r4TfPVwdYmcKij/YMXdARva+PuYeDZWnrfam2480IjZcrH8YWYFs59Pey+Z1UB3oiSQ10KsTW0IH19jC6AbkP4ITp7mb1wkMTvqp9z/E6ODkyMmiiHM= ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-22T19:03:34.965 INFO:teuthology.orchestra.run.smithi062.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmAyE1JM9vVlFNEmwIHiZnbbDWwEtnXWvaQo/N379txO/6dCSOpgUEuYXwv4RHdQ8dJ0qhVSNqhqbUxie380q2Hd6PwCpL31+ZsQsfbFo/yVJph9Ndks+69wDfBsoZ8n47UVJ9z87npu5FYOx8w5mejPfnrmzdsvyCQedwRaOmo4MaAXPQulMrIeLFFmWfvgvFEo8SIfl/6A/9FinMznzuNTrXntVyn5+o6bqVPE5lLC4biTy74vkkcZWvLQY5RhoeZ+1MWvwDAS43OZKR9yQDrHbrEeXuQ3STqOCzB2hRHod6hPbWMwnbJuwYLk1r6i8Czq72vcTADkWyxQ8BDqeO4v22lbFIyY0JFqF687noIbIiICEQ8qpmJOE9a7sNtQSlgRi2zwal6dd+r4TfPVwdYmcKij/YMXdARva+PuYeDZWnrfam2480IjZcrH8YWYFs59Pey+Z1UB3oiSQ10KsTW0IH19jC6AbkP4ITp7mb1wkMTvqp9z/E6ODkyMmiiHM= ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:03:34.976 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmAyE1JM9vVlFNEmwIHiZnbbDWwEtnXWvaQo/N379txO/6dCSOpgUEuYXwv4RHdQ8dJ0qhVSNqhqbUxie380q2Hd6PwCpL31+ZsQsfbFo/yVJph9Ndks+69wDfBsoZ8n47UVJ9z87npu5FYOx8w5mejPfnrmzdsvyCQedwRaOmo4MaAXPQulMrIeLFFmWfvgvFEo8SIfl/6A/9FinMznzuNTrXntVyn5+o6bqVPE5lLC4biTy74vkkcZWvLQY5RhoeZ+1MWvwDAS43OZKR9yQDrHbrEeXuQ3STqOCzB2hRHod6hPbWMwnbJuwYLk1r6i8Czq72vcTADkWyxQ8BDqeO4v22lbFIyY0JFqF687noIbIiICEQ8qpmJOE9a7sNtQSlgRi2zwal6dd+r4TfPVwdYmcKij/YMXdARva+PuYeDZWnrfam2480IjZcrH8YWYFs59Pey+Z1UB3oiSQ10KsTW0IH19jC6AbkP4ITp7mb1wkMTvqp9z/E6ODkyMmiiHM= ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-22T19:03:35.021 INFO:teuthology.orchestra.run.smithi063.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmAyE1JM9vVlFNEmwIHiZnbbDWwEtnXWvaQo/N379txO/6dCSOpgUEuYXwv4RHdQ8dJ0qhVSNqhqbUxie380q2Hd6PwCpL31+ZsQsfbFo/yVJph9Ndks+69wDfBsoZ8n47UVJ9z87npu5FYOx8w5mejPfnrmzdsvyCQedwRaOmo4MaAXPQulMrIeLFFmWfvgvFEo8SIfl/6A/9FinMznzuNTrXntVyn5+o6bqVPE5lLC4biTy74vkkcZWvLQY5RhoeZ+1MWvwDAS43OZKR9yQDrHbrEeXuQ3STqOCzB2hRHod6hPbWMwnbJuwYLk1r6i8Czq72vcTADkWyxQ8BDqeO4v22lbFIyY0JFqF687noIbIiICEQ8qpmJOE9a7sNtQSlgRi2zwal6dd+r4TfPVwdYmcKij/YMXdARva+PuYeDZWnrfam2480IjZcrH8YWYFs59Pey+Z1UB3oiSQ10KsTW0IH19jC6AbkP4ITp7mb1wkMTvqp9z/E6ODkyMmiiHM= ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:03:35.034 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi063 2024-02-22T19:03:35.034 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-02-22T19:03:35.034 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/etc/ceph/ceph.conf 2024-02-22T19:03:35.053 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-02-22T19:03:35.054 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-22T19:03:35.113 INFO:tasks.cephadm:Adding host smithi063 to orchestrator... 2024-02-22T19:03:35.113 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph orch host add smithi063 2024-02-22T19:03:46.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:46 smithi062 bash[64101]: cluster 2024-02-22T19:03:45.430908+0000 mgr.y (mgr.14140) 3 : cluster [DBG] pgmap v3: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:03:48.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:48 smithi062 bash[64101]: cluster 2024-02-22T19:03:47.431316+0000 mgr.y (mgr.14140) 4 : cluster [DBG] pgmap v4: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:03:50.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:50 smithi062 bash[64101]: cluster 2024-02-22T19:03:49.431694+0000 mgr.y (mgr.14140) 5 : cluster [DBG] pgmap v5: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:03:52.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:52 smithi062 bash[64101]: cluster 2024-02-22T19:03:51.432022+0000 mgr.y (mgr.14140) 6 : cluster [DBG] pgmap v6: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:03:54.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:54 smithi062 bash[64101]: cluster 2024-02-22T19:03:53.432327+0000 mgr.y (mgr.14140) 7 : cluster [DBG] pgmap v7: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:03:56.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:56 smithi062 bash[64101]: cluster 2024-02-22T19:03:55.432573+0000 mgr.y (mgr.14140) 8 : cluster [DBG] pgmap v8: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:03:58.783 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:58 smithi062 bash[64101]: cluster 2024-02-22T19:03:57.432966+0000 mgr.y (mgr.14140) 9 : cluster [DBG] pgmap v9: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:03:59.234 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:03:58 smithi062 bash[64334]: Warning: Permanently added 'smithi063,172.21.15.63' (ECDSA) to the list of known hosts. 2024-02-22T19:03:59.754 INFO:teuthology.orchestra.run.smithi063.stdout:Added host 'smithi063' 2024-02-22T19:03:59.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:59 smithi062 bash[64101]: audit 2024-02-22T19:03:59.252228+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"smithi062\", \"labels\": [], \"status\": \"\"}, \"smithi063\": {\"hostname\": \"smithi063\", \"addr\": \"smithi063\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-22T19:03:59.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:59 smithi062 bash[64101]: audit 2024-02-22T19:03:59.254487+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"smithi062\", \"labels\": [], \"status\": \"\"}, \"smithi063\": {\"hostname\": \"smithi063\", \"addr\": \"smithi063\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-22T19:03:59.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:03:59 smithi062 bash[64101]: audit 2024-02-22T19:03:59.483291+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:04:00.587 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph orch host ls --format=json 2024-02-22T19:04:00.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:00 smithi062 bash[64101]: audit 2024-02-22T19:03:58.749872+0000 mgr.y (mgr.14140) 10 : audit [DBG] from='client.14159 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi063", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:04:00.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:00 smithi062 bash[64101]: cephadm 2024-02-22T19:03:59.254932+0000 mgr.y (mgr.14140) 11 : cephadm [INF] Added host smithi063 2024-02-22T19:04:00.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:00 smithi062 bash[64101]: cluster 2024-02-22T19:03:59.433302+0000 mgr.y (mgr.14140) 12 : cluster [DBG] pgmap v10: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:00.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:00 smithi062 bash[64101]: audit 2024-02-22T19:03:59.485177+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:04:00.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:00 smithi062 bash[64101]: audit 2024-02-22T19:03:59.485815+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:04:00.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:00 smithi062 bash[64101]: audit 2024-02-22T19:03:59.694266+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-22T19:03:59.693929\", \"networks\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:04:00.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:00 smithi062 bash[64101]: audit 2024-02-22T19:03:59.696014+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-22T19:03:59.693929\", \"networks\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:04:00.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:00 smithi062 bash[64101]: audit 2024-02-22T19:03:59.696579+0000 mon.a (mon.0) 113 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:04:02.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:02 smithi062 bash[64101]: cluster 2024-02-22T19:04:01.433539+0000 mgr.y (mgr.14140) 13 : cluster [DBG] pgmap v11: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:03.590 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-02-22T19:04:03.590 INFO:teuthology.orchestra.run.smithi063.stdout:[{"addr": "smithi062", "hostname": "smithi062", "labels": [], "status": ""}, {"addr": "smithi063", "hostname": "smithi063", "labels": [], "status": ""}] 2024-02-22T19:04:04.558 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-22T19:04:04.558 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph osd crush tunables default 2024-02-22T19:04:04.943 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:04 smithi062 bash[64101]: cluster 2024-02-22T19:04:03.433845+0000 mgr.y (mgr.14140) 14 : cluster [DBG] pgmap v12: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:05.822 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:05 smithi062 bash[64101]: audit 2024-02-22T19:04:03.588284+0000 mgr.y (mgr.14140) 15 : audit [DBG] from='client.14161 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-22T19:04:05.822 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:05 smithi062 bash[64101]: audit 2024-02-22T19:04:05.231782+0000 mon.a (mon.0) 114 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:04:05.822 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:05 smithi062 bash[64101]: audit 2024-02-22T19:04:05.448385+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-22T19:03:59.693929\", \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:04:05.823 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:05 smithi062 bash[64101]: audit 2024-02-22T19:04:05.451085+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-22T19:03:59.693929\", \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:04:06.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:06 smithi062 bash[64101]: cluster 2024-02-22T19:04:05.434070+0000 mgr.y (mgr.14140) 16 : cluster [DBG] pgmap v13: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:07.502 INFO:teuthology.orchestra.run.smithi062.stderr:adjusted tunables profile to default 2024-02-22T19:04:07.913 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:07 smithi062 bash[64101]: audit 2024-02-22T19:04:06.509460+0000 mon.a (mon.0) 117 : audit [INF] from='client.? 172.21.15.62:0/3603006117' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-22T19:04:08.268 INFO:tasks.cephadm:Adding mon.c on smithi062 2024-02-22T19:04:08.268 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph orch daemon add mon 'smithi062:[v2:172.21.15.62:3301,v1:172.21.15.62:6790]=c' 2024-02-22T19:04:08.692 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:08 smithi062 bash[64101]: cluster 2024-02-22T19:04:07.434335+0000 mgr.y (mgr.14140) 17 : cluster [DBG] pgmap v14: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:08.692 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:08 smithi062 bash[64101]: audit 2024-02-22T19:04:07.497739+0000 mon.a (mon.0) 118 : audit [INF] from='client.? 172.21.15.62:0/3603006117' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-22T19:04:08.692 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:08 smithi062 bash[64101]: cluster 2024-02-22T19:04:07.497782+0000 mon.a (mon.0) 119 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-22T19:04:10.903 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:10 smithi062 bash[64101]: cluster 2024-02-22T19:04:09.434747+0000 mgr.y (mgr.14140) 18 : cluster [DBG] pgmap v16: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:10.903 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:10 smithi062 bash[64101]: audit 2024-02-22T19:04:10.472454+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:04:10.903 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:10 smithi062 bash[64101]: audit 2024-02-22T19:04:10.473003+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:04:10.903 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:10 smithi062 bash[64101]: audit 2024-02-22T19:04:10.473630+0000 mon.a (mon.0) 122 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2024-02-22T19:04:11.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:11 smithi062 bash[64101]: audit 2024-02-22T19:04:10.470927+0000 mgr.y (mgr.14140) 19 : audit [DBG] from='client.14165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi062:[v2:172.21.15.62:3301,v1:172.21.15.62:6790]=c", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:04:11.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:11 smithi062 bash[64101]: cephadm 2024-02-22T19:04:10.473408+0000 mgr.y (mgr.14140) 20 : cephadm [INF] Deploying daemon mon.c on smithi062 2024-02-22T19:04:12.864 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:12 smithi062 bash[64101]: cluster 2024-02-22T19:04:11.435098+0000 mgr.y (mgr.14140) 21 : cluster [DBG] pgmap v17: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:14.478 INFO:teuthology.orchestra.run.smithi062.stdout:Deployed mon.c on host 'smithi062' 2024-02-22T19:04:15.433 DEBUG:teuthology.orchestra.run.smithi062:mon.c> sudo journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.c.service 2024-02-22T19:04:15.435 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-22T19:04:15.436 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph mon dump -f json 2024-02-22T19:04:15.467 INFO:journalctl@ceph.mon.c.smithi062.stdout:-- Logs begin at Thu 2024-02-22 18:41:31 UTC. -- 2024-02-22T19:04:19.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[64101]: cluster 2024-02-22T19:04:14.236129+0000 mon.a (mon.0) 126 : cluster [INF] mon.a calling monitor election 2024-02-22T19:04:19.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[64101]: audit 2024-02-22T19:04:15.124420+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123717\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123800\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123835\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}}, \"last_daemon_update\": \"2024-02-22T19:04:15.123907\", \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:04:19.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[64101]: cluster 2024-02-22T19:04:15.435661+0000 mgr.y (mgr.14140) 23 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:19.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[64101]: cluster 2024-02-22T19:04:16.234881+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-02-22T19:04:19.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[64101]: cluster 2024-02-22T19:04:17.435986+0000 mgr.y (mgr.14140) 24 : cluster [DBG] pgmap v20: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:19.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[64101]: cluster 2024-02-22T19:04:19.251558+0000 mon.a (mon.0) 128 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-22T19:04:19.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[64101]: cluster 2024-02-22T19:04:19.256792+0000 mon.a (mon.0) 129 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0],c=[v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0]} 2024-02-22T19:04:19.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[64101]: cluster 2024-02-22T19:04:19.256841+0000 mon.a (mon.0) 130 : cluster [DBG] fsmap 2024-02-22T19:04:19.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[64101]: cluster 2024-02-22T19:04:19.256869+0000 mon.a (mon.0) 131 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-22T19:04:19.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[64101]: cluster 2024-02-22T19:04:19.257140+0000 mon.a (mon.0) 132 : cluster [DBG] mgrmap e13: y(active, since 53s) 2024-02-22T19:04:19.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[64101]: audit 2024-02-22T19:04:19.258187+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123717\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123800\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123835\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}}, \"last_daemon_update\": \"2024-02-22T19:04:15.123907\", \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:04:19.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[64101]: cluster 2024-02-22T19:04:19.260839+0000 mon.a (mon.0) 134 : cluster [INF] overall HEALTH_OK 2024-02-22T19:04:19.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[64101]: audit 2024-02-22T19:04:19.262800+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123717\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123800\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123835\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}}, \"last_daemon_update\": \"2024-02-22T19:04:15.123907\", \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:04:19.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[67442]: cluster 2024-02-22T19:04:14.236129+0000 mon.a (mon.0) 126 : cluster [INF] mon.a calling monitor election 2024-02-22T19:04:19.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[67442]: audit 2024-02-22T19:04:15.124420+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123717\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123800\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123835\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}}, \"last_daemon_update\": \"2024-02-22T19:04:15.123907\", \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:04:19.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[67442]: cluster 2024-02-22T19:04:15.435661+0000 mgr.y (mgr.14140) 23 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:19.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[67442]: cluster 2024-02-22T19:04:16.234881+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-02-22T19:04:19.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[67442]: cluster 2024-02-22T19:04:17.435986+0000 mgr.y (mgr.14140) 24 : cluster [DBG] pgmap v20: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:19.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[67442]: cluster 2024-02-22T19:04:19.251558+0000 mon.a (mon.0) 128 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-22T19:04:19.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[67442]: cluster 2024-02-22T19:04:19.256792+0000 mon.a (mon.0) 129 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0],c=[v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0]} 2024-02-22T19:04:19.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[67442]: cluster 2024-02-22T19:04:19.256841+0000 mon.a (mon.0) 130 : cluster [DBG] fsmap 2024-02-22T19:04:19.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[67442]: cluster 2024-02-22T19:04:19.256869+0000 mon.a (mon.0) 131 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-22T19:04:19.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[67442]: cluster 2024-02-22T19:04:19.257140+0000 mon.a (mon.0) 132 : cluster [DBG] mgrmap e13: y(active, since 53s) 2024-02-22T19:04:19.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[67442]: audit 2024-02-22T19:04:19.258187+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123717\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123800\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123835\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}}, \"last_daemon_update\": \"2024-02-22T19:04:15.123907\", \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:04:19.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[67442]: cluster 2024-02-22T19:04:19.260839+0000 mon.a (mon.0) 134 : cluster [INF] overall HEALTH_OK 2024-02-22T19:04:19.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:19 smithi062 bash[67442]: audit 2024-02-22T19:04:19.262800+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123717\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123800\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123835\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}}, \"last_daemon_update\": \"2024-02-22T19:04:15.123907\", \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:04:20.220 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T19:04:20.220 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":2,"fsid":"e2bc0d14-d1b4-11ee-95bf-87774f69a715","modified":"2024-02-22T19:04:14.234067Z","created":"2024-02-22T19:02:41.032114Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3301","nonce":0},{"type":"v1","addr":"172.21.15.62:6790","nonce":0}]},"addr":"172.21.15.62:6790/0","public_addr":"172.21.15.62:6790/0","priority":0,"weight":0}],"quorum":[0,1]} 2024-02-22T19:04:20.221 INFO:teuthology.orchestra.run.smithi062.stderr:dumped monmap epoch 2 2024-02-22T19:04:20.537 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:20 smithi062 bash[64101]: cluster 2024-02-22T19:04:19.436376+0000 mgr.y (mgr.14140) 25 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:20.537 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:20 smithi062 bash[64101]: audit 2024-02-22T19:04:20.219504+0000 mon.a (mon.0) 136 : audit [DBG] from='client.? 172.21.15.62:0/3352809912' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T19:04:20.537 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:20 smithi062 bash[67442]: cluster 2024-02-22T19:04:19.436376+0000 mgr.y (mgr.14140) 25 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:20.537 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:20 smithi062 bash[67442]: audit 2024-02-22T19:04:20.219504+0000 mon.a (mon.0) 136 : audit [DBG] from='client.? 172.21.15.62:0/3352809912' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T19:04:20.854 INFO:tasks.cephadm:Adding mon.b on smithi063 2024-02-22T19:04:20.855 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph orch daemon add mon smithi063:172.21.15.63=b 2024-02-22T19:04:22.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:22 smithi062 bash[64101]: cluster 2024-02-22T19:04:21.436705+0000 mgr.y (mgr.14140) 26 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:22.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:22 smithi062 bash[67442]: cluster 2024-02-22T19:04:21.436705+0000 mgr.y (mgr.14140) 26 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:23.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:23 smithi062 bash[64101]: audit 2024-02-22T19:04:23.138108+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:04:23.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:23 smithi062 bash[64101]: audit 2024-02-22T19:04:23.138987+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:04:23.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:23 smithi062 bash[64101]: audit 2024-02-22T19:04:23.139977+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2024-02-22T19:04:23.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:23 smithi062 bash[67442]: audit 2024-02-22T19:04:23.138108+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:04:23.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:23 smithi062 bash[67442]: audit 2024-02-22T19:04:23.138987+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:04:23.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:23 smithi062 bash[67442]: audit 2024-02-22T19:04:23.139977+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2024-02-22T19:04:24.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:24 smithi062 bash[64101]: audit 2024-02-22T19:04:23.136722+0000 mgr.y (mgr.14140) 27 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi063:172.21.15.63=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:04:24.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:24 smithi062 bash[64101]: cephadm 2024-02-22T19:04:23.139631+0000 mgr.y (mgr.14140) 28 : cephadm [INF] Deploying daemon mon.b on smithi063 2024-02-22T19:04:24.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:24 smithi062 bash[64101]: cluster 2024-02-22T19:04:23.436923+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:24.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:24 smithi062 bash[67442]: audit 2024-02-22T19:04:23.136722+0000 mgr.y (mgr.14140) 27 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi063:172.21.15.63=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:04:24.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:24 smithi062 bash[67442]: cephadm 2024-02-22T19:04:23.139631+0000 mgr.y (mgr.14140) 28 : cephadm [INF] Deploying daemon mon.b on smithi063 2024-02-22T19:04:24.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:24 smithi062 bash[67442]: cluster 2024-02-22T19:04:23.436923+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:26.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:26 smithi062 bash[64101]: cluster 2024-02-22T19:04:25.437251+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:26.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:26 smithi062 bash[67442]: cluster 2024-02-22T19:04:25.437251+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:27.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:27 smithi062 bash[64101]: cluster 2024-02-22T19:04:26.409066+0000 mon.a (mon.0) 140 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-22T19:04:27.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:27 smithi062 bash[67442]: cluster 2024-02-22T19:04:26.409066+0000 mon.a (mon.0) 140 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-22T19:04:28.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:28 smithi062 bash[64101]: cluster 2024-02-22T19:04:27.437795+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:28.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:28 smithi062 bash[67442]: cluster 2024-02-22T19:04:27.437795+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:30.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:30 smithi062 bash[64101]: cluster 2024-02-22T19:04:29.438334+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:30.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:30 smithi062 bash[67442]: cluster 2024-02-22T19:04:29.438334+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:32.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:32 smithi062 bash[64101]: cluster 2024-02-22T19:04:31.438715+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:32.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:32 smithi062 bash[67442]: cluster 2024-02-22T19:04:31.438715+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:34.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:34 smithi062 bash[64101]: cluster 2024-02-22T19:04:33.439000+0000 mgr.y (mgr.14140) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:34.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:34 smithi062 bash[67442]: cluster 2024-02-22T19:04:33.439000+0000 mgr.y (mgr.14140) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:35.156 INFO:teuthology.orchestra.run.smithi063.stdout:Deployed mon.b on host 'smithi063' 2024-02-22T19:04:35.854 DEBUG:teuthology.orchestra.run.smithi063:mon.b> sudo journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.b.service 2024-02-22T19:04:35.859 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-02-22T19:04:35.860 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph mon dump -f json 2024-02-22T19:04:35.888 INFO:journalctl@ceph.mon.b.smithi063.stdout:-- Logs begin at Thu 2024-02-22 18:41:51 UTC. -- 2024-02-22T19:04:40.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:40 smithi063 bash[35391]: cluster 2024-02-22T19:04:35.157732+0000 mon.a (mon.0) 144 : cluster [INF] mon.a calling monitor election 2024-02-22T19:04:40.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:40 smithi063 bash[35391]: cluster 2024-02-22T19:04:35.160561+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-02-22T19:04:40.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:40 smithi063 bash[35391]: cluster 2024-02-22T19:04:35.439399+0000 mgr.y (mgr.14140) 35 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:40.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:40 smithi063 bash[35391]: audit 2024-02-22T19:04:36.796014+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:36.795342\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}}, \"last_daemon_update\": \"2024-02-22T19:04:36.795487\", \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:04:40.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:40 smithi063 bash[35391]: cluster 2024-02-22T19:04:37.153261+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-02-22T19:04:40.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:40 smithi063 bash[35391]: cluster 2024-02-22T19:04:37.439772+0000 mgr.y (mgr.14140) 36 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:40.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:40 smithi063 bash[35391]: cluster 2024-02-22T19:04:39.439990+0000 mgr.y (mgr.14140) 37 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:40.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:40 smithi063 bash[35391]: cluster 2024-02-22T19:04:40.184419+0000 mon.a (mon.0) 146 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-22T19:04:40.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:40 smithi063 bash[35391]: cluster 2024-02-22T19:04:40.192164+0000 mon.a (mon.0) 147 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0],b=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],c=[v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0]} 2024-02-22T19:04:40.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:40 smithi063 bash[35391]: cluster 2024-02-22T19:04:40.192213+0000 mon.a (mon.0) 148 : cluster [DBG] fsmap 2024-02-22T19:04:40.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:40 smithi063 bash[35391]: cluster 2024-02-22T19:04:40.192240+0000 mon.a (mon.0) 149 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-22T19:04:40.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:40 smithi063 bash[35391]: cluster 2024-02-22T19:04:40.192446+0000 mon.a (mon.0) 150 : cluster [DBG] mgrmap e13: y(active, since 74s) 2024-02-22T19:04:40.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:40 smithi063 bash[35391]: audit 2024-02-22T19:04:40.193261+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:36.795342\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}}, \"last_daemon_update\": \"2024-02-22T19:04:36.795487\", \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:04:40.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:40 smithi063 bash[35391]: cluster 2024-02-22T19:04:40.197776+0000 mon.a (mon.0) 152 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2024-02-22T19:04:40.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:40 smithi063 bash[35391]: audit 2024-02-22T19:04:40.203197+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:36.795342\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}}, \"last_daemon_update\": \"2024-02-22T19:04:36.795487\", \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:04:40.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[67442]: cluster 2024-02-22T19:04:35.157732+0000 mon.a (mon.0) 144 : cluster [INF] mon.a calling monitor election 2024-02-22T19:04:40.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[67442]: cluster 2024-02-22T19:04:35.160561+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-02-22T19:04:40.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[67442]: cluster 2024-02-22T19:04:35.439399+0000 mgr.y (mgr.14140) 35 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:40.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[67442]: audit 2024-02-22T19:04:36.796014+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:36.795342\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}}, \"last_daemon_update\": \"2024-02-22T19:04:36.795487\", \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:04:40.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[67442]: cluster 2024-02-22T19:04:37.153261+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-02-22T19:04:40.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[67442]: cluster 2024-02-22T19:04:37.439772+0000 mgr.y (mgr.14140) 36 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:40.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[67442]: cluster 2024-02-22T19:04:39.439990+0000 mgr.y (mgr.14140) 37 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:40.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[67442]: cluster 2024-02-22T19:04:40.184419+0000 mon.a (mon.0) 146 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-22T19:04:40.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[64101]: cluster 2024-02-22T19:04:35.157732+0000 mon.a (mon.0) 144 : cluster [INF] mon.a calling monitor election 2024-02-22T19:04:40.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[64101]: cluster 2024-02-22T19:04:35.160561+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-02-22T19:04:40.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[64101]: cluster 2024-02-22T19:04:35.439399+0000 mgr.y (mgr.14140) 35 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:40.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[64101]: audit 2024-02-22T19:04:36.796014+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:36.795342\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}}, \"last_daemon_update\": \"2024-02-22T19:04:36.795487\", \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:04:40.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[64101]: cluster 2024-02-22T19:04:37.153261+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-02-22T19:04:40.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[64101]: cluster 2024-02-22T19:04:37.439772+0000 mgr.y (mgr.14140) 36 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:40.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[64101]: cluster 2024-02-22T19:04:39.439990+0000 mgr.y (mgr.14140) 37 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:40.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[64101]: cluster 2024-02-22T19:04:40.184419+0000 mon.a (mon.0) 146 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-22T19:04:40.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[64101]: cluster 2024-02-22T19:04:40.192164+0000 mon.a (mon.0) 147 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0],b=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],c=[v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0]} 2024-02-22T19:04:40.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[64101]: cluster 2024-02-22T19:04:40.192213+0000 mon.a (mon.0) 148 : cluster [DBG] fsmap 2024-02-22T19:04:40.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[64101]: cluster 2024-02-22T19:04:40.192240+0000 mon.a (mon.0) 149 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-22T19:04:40.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[64101]: cluster 2024-02-22T19:04:40.192446+0000 mon.a (mon.0) 150 : cluster [DBG] mgrmap e13: y(active, since 74s) 2024-02-22T19:04:40.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[64101]: audit 2024-02-22T19:04:40.193261+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:36.795342\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}}, \"last_daemon_update\": \"2024-02-22T19:04:36.795487\", \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:04:40.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[64101]: cluster 2024-02-22T19:04:40.197776+0000 mon.a (mon.0) 152 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2024-02-22T19:04:40.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[64101]: audit 2024-02-22T19:04:40.203197+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:36.795342\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}}, \"last_daemon_update\": \"2024-02-22T19:04:36.795487\", \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:04:40.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[67442]: cluster 2024-02-22T19:04:40.192164+0000 mon.a (mon.0) 147 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0],b=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],c=[v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0]} 2024-02-22T19:04:40.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[67442]: cluster 2024-02-22T19:04:40.192213+0000 mon.a (mon.0) 148 : cluster [DBG] fsmap 2024-02-22T19:04:40.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[67442]: cluster 2024-02-22T19:04:40.192240+0000 mon.a (mon.0) 149 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-22T19:04:40.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[67442]: cluster 2024-02-22T19:04:40.192446+0000 mon.a (mon.0) 150 : cluster [DBG] mgrmap e13: y(active, since 74s) 2024-02-22T19:04:40.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[67442]: audit 2024-02-22T19:04:40.193261+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:36.795342\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}}, \"last_daemon_update\": \"2024-02-22T19:04:36.795487\", \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:04:40.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[67442]: cluster 2024-02-22T19:04:40.197776+0000 mon.a (mon.0) 152 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2024-02-22T19:04:40.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:40 smithi062 bash[67442]: audit 2024-02-22T19:04:40.203197+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:36.795342\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}}, \"last_daemon_update\": \"2024-02-22T19:04:36.795487\", \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:04:40.750 INFO:teuthology.orchestra.run.smithi063.stdout: 2024-02-22T19:04:40.750 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":3,"fsid":"e2bc0d14-d1b4-11ee-95bf-87774f69a715","modified":"2024-02-22T19:04:35.152233Z","created":"2024-02-22T19:02:41.032114Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3301","nonce":0},{"type":"v1","addr":"172.21.15.62:6790","nonce":0}]},"addr":"172.21.15.62:6790/0","public_addr":"172.21.15.62:6790/0","priority":0,"weight":0},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0}],"quorum":[0,1,2]} 2024-02-22T19:04:40.751 INFO:teuthology.orchestra.run.smithi063.stderr:dumped monmap epoch 3 2024-02-22T19:04:41.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:41 smithi063 bash[35391]: audit 2024-02-22T19:04:40.749338+0000 mon.a (mon.0) 154 : audit [DBG] from='client.? 172.21.15.63:0/211346885' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T19:04:41.484 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-22T19:04:41.485 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph config generate-minimal-conf 2024-02-22T19:04:41.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:41 smithi062 bash[64101]: audit 2024-02-22T19:04:40.749338+0000 mon.a (mon.0) 154 : audit [DBG] from='client.? 172.21.15.63:0/211346885' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T19:04:41.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:41 smithi062 bash[67442]: audit 2024-02-22T19:04:40.749338+0000 mon.a (mon.0) 154 : audit [DBG] from='client.? 172.21.15.63:0/211346885' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-22T19:04:42.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:42 smithi063 bash[35391]: cluster 2024-02-22T19:04:41.440396+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:42.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:42 smithi062 bash[64101]: cluster 2024-02-22T19:04:41.440396+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:42.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:42 smithi062 bash[67442]: cluster 2024-02-22T19:04:41.440396+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:43.606 INFO:teuthology.orchestra.run.smithi062.stdout:# minimal ceph.conf for e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:04:43.606 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2024-02-22T19:04:43.606 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:04:43.606 INFO:teuthology.orchestra.run.smithi062.stdout: mon_host = [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-02-22T19:04:44.343 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-22T19:04:44.343 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-22T19:04:44.343 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.conf 2024-02-22T19:04:44.376 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-22T19:04:44.376 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-22T19:04:44.446 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-02-22T19:04:44.446 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.conf 2024-02-22T19:04:44.484 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-02-22T19:04:44.484 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-22T19:04:44.556 INFO:tasks.cephadm:Adding mgr.y on smithi062 2024-02-22T19:04:44.556 INFO:tasks.cephadm:Adding mgr.x on smithi063 2024-02-22T19:04:44.556 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph orch apply mgr '2;smithi062=y;smithi063=x' 2024-02-22T19:04:44.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:44 smithi062 bash[64101]: cluster 2024-02-22T19:04:43.440685+0000 mgr.y (mgr.14140) 39 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:44.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:44 smithi062 bash[64101]: audit 2024-02-22T19:04:43.605438+0000 mon.a (mon.0) 155 : audit [DBG] from='client.? 172.21.15.62:0/2598378175' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:04:44.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:44 smithi062 bash[67442]: cluster 2024-02-22T19:04:43.440685+0000 mgr.y (mgr.14140) 39 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:44.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:44 smithi062 bash[67442]: audit 2024-02-22T19:04:43.605438+0000 mon.a (mon.0) 155 : audit [DBG] from='client.? 172.21.15.62:0/2598378175' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:04:44.952 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:44 smithi063 bash[35391]: cluster 2024-02-22T19:04:43.440685+0000 mgr.y (mgr.14140) 39 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:44.952 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:44 smithi063 bash[35391]: audit 2024-02-22T19:04:43.605438+0000 mon.a (mon.0) 155 : audit [DBG] from='client.? 172.21.15.62:0/2598378175' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:04:46.633 INFO:teuthology.orchestra.run.smithi063.stdout:Scheduled mgr update... 2024-02-22T19:04:46.664 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:46 smithi063 bash[35391]: cluster 2024-02-22T19:04:45.440999+0000 mgr.y (mgr.14140) 40 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:46.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:46 smithi062 bash[64101]: cluster 2024-02-22T19:04:45.440999+0000 mgr.y (mgr.14140) 40 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:46.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:46 smithi062 bash[67442]: cluster 2024-02-22T19:04:45.440999+0000 mgr.y (mgr.14140) 40 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:47.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:47 smithi063 bash[35391]: audit 2024-02-22T19:04:46.628225+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-02-22T19:04:46.627820\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi062\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi063\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2024-02-22T19:04:47.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:47 smithi063 bash[35391]: audit 2024-02-22T19:04:46.630806+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-02-22T19:04:46.627820\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi062\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi063\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2024-02-22T19:04:47.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:47 smithi063 bash[35391]: audit 2024-02-22T19:04:46.632188+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:04:47.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:47 smithi063 bash[35391]: audit 2024-02-22T19:04:46.637633+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-22T19:04:47.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:47 smithi063 bash[35391]: audit 2024-02-22T19:04:46.638402+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:04:47.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:47 smithi063 bash[35391]: audit 2024-02-22T19:04:46.639471+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-22T19:04:47.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:47 smithi062 bash[64101]: audit 2024-02-22T19:04:46.628225+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-02-22T19:04:46.627820\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi062\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi063\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2024-02-22T19:04:47.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:47 smithi062 bash[64101]: audit 2024-02-22T19:04:46.630806+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-02-22T19:04:46.627820\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi062\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi063\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2024-02-22T19:04:47.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:47 smithi062 bash[64101]: audit 2024-02-22T19:04:46.632188+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:04:47.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:47 smithi062 bash[64101]: audit 2024-02-22T19:04:46.637633+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-22T19:04:47.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:47 smithi062 bash[64101]: audit 2024-02-22T19:04:46.638402+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:04:47.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:47 smithi062 bash[64101]: audit 2024-02-22T19:04:46.639471+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-22T19:04:47.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:47 smithi062 bash[67442]: audit 2024-02-22T19:04:46.628225+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-02-22T19:04:46.627820\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi062\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi063\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2024-02-22T19:04:47.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:47 smithi062 bash[67442]: audit 2024-02-22T19:04:46.630806+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-02-22T19:04:46.627820\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi062\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi063\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2024-02-22T19:04:47.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:47 smithi062 bash[67442]: audit 2024-02-22T19:04:46.632188+0000 mon.a (mon.0) 158 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:04:47.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:47 smithi062 bash[67442]: audit 2024-02-22T19:04:46.637633+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-22T19:04:47.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:47 smithi062 bash[67442]: audit 2024-02-22T19:04:46.638402+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:04:47.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:47 smithi062 bash[67442]: audit 2024-02-22T19:04:46.639471+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-22T19:04:48.634 DEBUG:teuthology.orchestra.run.smithi063:mgr.x> sudo journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mgr.x.service 2024-02-22T19:04:48.636 INFO:tasks.cephadm:Deploying OSDs... 2024-02-22T19:04:48.637 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-22T19:04:48.637 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2024-02-22T19:04:48.660 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-22T19:04:48.660 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2024-02-22T19:04:48.671 INFO:journalctl@ceph.mgr.x.smithi063.stdout:-- Logs begin at Thu 2024-02-22 18:41:51 UTC. -- 2024-02-22T19:04:48.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:48 smithi063 bash[35391]: audit 2024-02-22T19:04:46.627174+0000 mgr.y (mgr.14140) 41 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi062=y;smithi063=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:04:48.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:48 smithi063 bash[35391]: cephadm 2024-02-22T19:04:46.627805+0000 mgr.y (mgr.14140) 42 : cephadm [INF] Saving service mgr spec with placement count:2 smithi062=y,smithi063=x 2024-02-22T19:04:48.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:48 smithi063 bash[35391]: cephadm 2024-02-22T19:04:46.639021+0000 mgr.y (mgr.14140) 43 : cephadm [INF] Deploying daemon mgr.x on smithi063 2024-02-22T19:04:48.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:48 smithi063 bash[35391]: cluster 2024-02-22T19:04:47.441397+0000 mgr.y (mgr.14140) 44 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:48.721 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-22T19:04:48.721 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T19:04:48.721 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 191363 Links: 1 2024-02-22T19:04:48.722 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T19:04:48.722 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-02-22T19:04:48.722 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-02-22 19:04:13.401486976 +0000 2024-02-22T19:04:48.722 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-02-22 19:00:25.207596566 +0000 2024-02-22T19:04:48.722 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-02-22 19:00:25.207596566 +0000 2024-02-22T19:04:48.722 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-02-22T19:04:48.722 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-22T19:04:48.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:48 smithi062 bash[64101]: audit 2024-02-22T19:04:46.627174+0000 mgr.y (mgr.14140) 41 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi062=y;smithi063=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:04:48.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:48 smithi062 bash[64101]: cephadm 2024-02-22T19:04:46.627805+0000 mgr.y (mgr.14140) 42 : cephadm [INF] Saving service mgr spec with placement count:2 smithi062=y,smithi063=x 2024-02-22T19:04:48.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:48 smithi062 bash[64101]: cephadm 2024-02-22T19:04:46.639021+0000 mgr.y (mgr.14140) 43 : cephadm [INF] Deploying daemon mgr.x on smithi063 2024-02-22T19:04:48.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:48 smithi062 bash[64101]: cluster 2024-02-22T19:04:47.441397+0000 mgr.y (mgr.14140) 44 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:48.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:48 smithi062 bash[67442]: audit 2024-02-22T19:04:46.627174+0000 mgr.y (mgr.14140) 41 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi062=y;smithi063=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:04:48.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:48 smithi062 bash[67442]: cephadm 2024-02-22T19:04:46.627805+0000 mgr.y (mgr.14140) 42 : cephadm [INF] Saving service mgr spec with placement count:2 smithi062=y,smithi063=x 2024-02-22T19:04:48.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:48 smithi062 bash[67442]: cephadm 2024-02-22T19:04:46.639021+0000 mgr.y (mgr.14140) 43 : cephadm [INF] Deploying daemon mgr.x on smithi063 2024-02-22T19:04:48.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:48 smithi062 bash[67442]: cluster 2024-02-22T19:04:47.441397+0000 mgr.y (mgr.14140) 44 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:48.764 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-02-22T19:04:48.764 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-02-22T19:04:48.764 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000267624 s, 1.9 MB/s 2024-02-22T19:04:48.765 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-22T19:04:48.826 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2024-02-22T19:04:48.886 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-22T19:04:48.886 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T19:04:48.886 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 188132 Links: 1 2024-02-22T19:04:48.887 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T19:04:48.887 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-02-22T19:04:48.887 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-02-22 19:04:13.401486976 +0000 2024-02-22T19:04:48.887 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-02-22 19:00:25.559590876 +0000 2024-02-22T19:04:48.887 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-02-22 19:00:25.559590876 +0000 2024-02-22T19:04:48.887 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-02-22T19:04:48.887 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-22T19:04:48.954 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-02-22T19:04:48.955 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-02-22T19:04:48.955 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000219975 s, 2.3 MB/s 2024-02-22T19:04:48.956 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-22T19:04:49.016 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2024-02-22T19:04:49.075 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-22T19:04:49.075 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T19:04:49.075 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 195095 Links: 1 2024-02-22T19:04:49.075 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T19:04:49.075 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-02-22T19:04:49.075 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-02-22 19:04:13.401486976 +0000 2024-02-22T19:04:49.075 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-02-22 19:00:25.922585008 +0000 2024-02-22T19:04:49.076 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-02-22 19:00:25.922585008 +0000 2024-02-22T19:04:49.076 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-02-22T19:04:49.076 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-22T19:04:49.143 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-02-22T19:04:49.143 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-02-22T19:04:49.143 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000181385 s, 2.8 MB/s 2024-02-22T19:04:49.144 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-22T19:04:49.205 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2024-02-22T19:04:49.264 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-22T19:04:49.264 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T19:04:49.264 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 6h/6d Inode: 197202 Links: 1 2024-02-22T19:04:49.264 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T19:04:49.264 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-02-22T19:04:49.264 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-02-22 19:04:13.401486976 +0000 2024-02-22T19:04:49.264 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-02-22 19:00:26.276579286 +0000 2024-02-22T19:04:49.264 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-02-22 19:00:26.276579286 +0000 2024-02-22T19:04:49.265 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-02-22T19:04:49.265 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-22T19:04:49.331 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-02-22T19:04:49.331 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-02-22T19:04:49.331 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000228144 s, 2.2 MB/s 2024-02-22T19:04:49.332 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-22T19:04:49.392 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-02-22T19:04:49.392 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/scratch_devs of=/dev/stdout 2024-02-22T19:04:49.413 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-22T19:04:49.413 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_1 2024-02-22T19:04:49.471 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-22T19:04:49.471 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T19:04:49.472 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 168175 Links: 1 2024-02-22T19:04:49.472 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T19:04:49.472 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-02-22T19:04:49.472 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-02-22 19:04:48.490752552 +0000 2024-02-22T19:04:49.472 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-02-22 19:00:27.484195679 +0000 2024-02-22T19:04:49.472 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-02-22 19:00:27.484195679 +0000 2024-02-22T19:04:49.472 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2024-02-22T19:04:49.472 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-22T19:04:49.539 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:49 smithi063 bash[35391]: audit 2024-02-22T19:04:48.683310+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:36.795342\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}}, \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:04:49.539 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:49 smithi063 bash[35391]: audit 2024-02-22T19:04:48.686313+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:36.795342\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}}, \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:04:49.539 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:49 smithi063 bash[35391]: audit 2024-02-22T19:04:48.686960+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:04:49.541 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-02-22T19:04:49.542 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-02-22T19:04:49.542 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000210409 s, 2.4 MB/s 2024-02-22T19:04:49.543 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-22T19:04:49.603 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_2 2024-02-22T19:04:49.661 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-22T19:04:49.661 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T19:04:49.661 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 161630 Links: 1 2024-02-22T19:04:49.661 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T19:04:49.661 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-02-22T19:04:49.661 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-02-22 19:04:48.490752552 +0000 2024-02-22T19:04:49.661 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-02-22 19:00:27.830192097 +0000 2024-02-22T19:04:49.661 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-02-22 19:00:27.830192097 +0000 2024-02-22T19:04:49.662 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2024-02-22T19:04:49.662 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-22T19:04:49.728 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-02-22T19:04:49.728 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-02-22T19:04:49.728 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000195977 s, 2.6 MB/s 2024-02-22T19:04:49.729 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-22T19:04:49.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:49 smithi062 bash[64101]: audit 2024-02-22T19:04:48.683310+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:36.795342\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}}, \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:04:49.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:49 smithi062 bash[64101]: audit 2024-02-22T19:04:48.686313+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:36.795342\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}}, \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:04:49.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:49 smithi062 bash[64101]: audit 2024-02-22T19:04:48.686960+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:04:49.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:49 smithi062 bash[67442]: audit 2024-02-22T19:04:48.683310+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:36.795342\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}}, \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:04:49.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:49 smithi062 bash[67442]: audit 2024-02-22T19:04:48.686313+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:36.795342\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}}, \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:04:49.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:49 smithi062 bash[67442]: audit 2024-02-22T19:04:48.686960+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:04:49.789 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_3 2024-02-22T19:04:49.847 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-22T19:04:49.847 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T19:04:49.848 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 168252 Links: 1 2024-02-22T19:04:49.848 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T19:04:49.848 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-02-22T19:04:49.848 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-02-22 19:04:48.490752552 +0000 2024-02-22T19:04:49.848 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-02-22 19:00:28.184188433 +0000 2024-02-22T19:04:49.848 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-02-22 19:00:28.184188433 +0000 2024-02-22T19:04:49.848 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2024-02-22T19:04:49.848 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-22T19:04:49.915 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-02-22T19:04:49.915 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-02-22T19:04:49.915 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000176179 s, 2.9 MB/s 2024-02-22T19:04:49.916 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-22T19:04:49.978 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_4 2024-02-22T19:04:50.037 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-22T19:04:50.037 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-22T19:04:50.038 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 6h/6d Inode: 161757 Links: 1 2024-02-22T19:04:50.038 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-22T19:04:50.038 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2024-02-22T19:04:50.038 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2024-02-22 19:04:48.490752552 +0000 2024-02-22T19:04:50.038 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2024-02-22 19:00:28.560184542 +0000 2024-02-22T19:04:50.038 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2024-02-22 19:00:28.560184542 +0000 2024-02-22T19:04:50.038 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: - 2024-02-22T19:04:50.038 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-22T19:04:50.106 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2024-02-22T19:04:50.106 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2024-02-22T19:04:50.106 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000209736 s, 2.4 MB/s 2024-02-22T19:04:50.107 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-22T19:04:50.167 INFO:tasks.cephadm:Deploying osd.0 on smithi062 with /dev/vg_nvme/lv_4... 2024-02-22T19:04:50.167 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-22T19:04:50.460 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:50 smithi062 bash[64101]: cluster 2024-02-22T19:04:49.441838+0000 mgr.y (mgr.14140) 45 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:50.460 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:50 smithi062 bash[64101]: audit 2024-02-22T19:04:49.997899+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997210\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997296\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}}, \"last_daemon_update\": \"2024-02-22T19:04:49.997381\", \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:04:50.460 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:50 smithi062 bash[64101]: audit 2024-02-22T19:04:50.000543+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997210\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997296\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}}, \"last_daemon_update\": \"2024-02-22T19:04:49.997381\", \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:04:50.460 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:50 smithi062 bash[64101]: audit 2024-02-22T19:04:50.001810+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2024-02-22T19:04:50.460 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:50 smithi062 bash[64101]: audit 2024-02-22T19:04:50.002553+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:04:50.460 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:50 smithi062 bash[64101]: audit 2024-02-22T19:04:50.003473+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2024-02-22T19:04:50.461 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:50 smithi062 bash[67442]: cluster 2024-02-22T19:04:49.441838+0000 mgr.y (mgr.14140) 45 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:50.461 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:50 smithi062 bash[67442]: audit 2024-02-22T19:04:49.997899+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997210\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997296\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}}, \"last_daemon_update\": \"2024-02-22T19:04:49.997381\", \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:04:50.461 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:50 smithi062 bash[67442]: audit 2024-02-22T19:04:50.000543+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997210\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997296\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}}, \"last_daemon_update\": \"2024-02-22T19:04:49.997381\", \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:04:50.461 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:50 smithi062 bash[67442]: audit 2024-02-22T19:04:50.001810+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2024-02-22T19:04:50.461 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:50 smithi062 bash[67442]: audit 2024-02-22T19:04:50.002553+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:04:50.461 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:50 smithi062 bash[67442]: audit 2024-02-22T19:04:50.003473+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2024-02-22T19:04:50.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:50 smithi063 bash[35391]: cluster 2024-02-22T19:04:49.441838+0000 mgr.y (mgr.14140) 45 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:50.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:50 smithi063 bash[35391]: audit 2024-02-22T19:04:49.997899+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997210\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997296\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}}, \"last_daemon_update\": \"2024-02-22T19:04:49.997381\", \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:04:50.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:50 smithi063 bash[35391]: audit 2024-02-22T19:04:50.000543+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997210\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997296\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}}, \"last_daemon_update\": \"2024-02-22T19:04:49.997381\", \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:04:50.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:50 smithi063 bash[35391]: audit 2024-02-22T19:04:50.001810+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2024-02-22T19:04:50.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:50 smithi063 bash[35391]: audit 2024-02-22T19:04:50.002553+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:04:50.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:50 smithi063 bash[35391]: audit 2024-02-22T19:04:50.003473+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2024-02-22T19:04:51.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:51 smithi063 bash[35391]: cephadm 2024-02-22T19:04:50.001566+0000 mgr.y (mgr.14140) 46 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-02-22T19:04:51.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:51 smithi063 bash[35391]: cephadm 2024-02-22T19:04:50.003171+0000 mgr.y (mgr.14140) 47 : cephadm [INF] Reconfiguring daemon mgr.y on smithi062 2024-02-22T19:04:51.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:51 smithi062 bash[64101]: cephadm 2024-02-22T19:04:50.001566+0000 mgr.y (mgr.14140) 46 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-02-22T19:04:51.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:51 smithi062 bash[64101]: cephadm 2024-02-22T19:04:50.003171+0000 mgr.y (mgr.14140) 47 : cephadm [INF] Reconfiguring daemon mgr.y on smithi062 2024-02-22T19:04:51.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:51 smithi062 bash[67442]: cephadm 2024-02-22T19:04:50.001566+0000 mgr.y (mgr.14140) 46 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-02-22T19:04:51.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:51 smithi062 bash[67442]: cephadm 2024-02-22T19:04:50.003171+0000 mgr.y (mgr.14140) 47 : cephadm [INF] Reconfiguring daemon mgr.y on smithi062 2024-02-22T19:04:52.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:52 smithi063 bash[35391]: cluster 2024-02-22T19:04:51.442038+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:52.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:52 smithi062 bash[64101]: cluster 2024-02-22T19:04:51.442038+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:52.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:52 smithi062 bash[67442]: cluster 2024-02-22T19:04:51.442038+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:53.448 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:53 smithi062 bash[67442]: audit 2024-02-22T19:04:52.929882+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123717\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123835\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}}, \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:04:53.448 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:53 smithi062 bash[67442]: audit 2024-02-22T19:04:52.932589+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123717\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123835\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}}, \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:04:53.448 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:53 smithi062 bash[67442]: audit 2024-02-22T19:04:52.933343+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:04:53.449 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:53 smithi062 bash[67442]: cluster 2024-02-22T19:04:53.180798+0000 mon.a (mon.0) 173 : cluster [DBG] Standby manager daemon x started 2024-02-22T19:04:53.449 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:53 smithi062 bash[67442]: audit 2024-02-22T19:04:53.181624+0000 mon.c (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.63:0/3778676503' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:04:53.449 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:53 smithi062 bash[67442]: audit 2024-02-22T19:04:53.182744+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.63:0/3778676503' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:04:53.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:53 smithi063 bash[35391]: audit 2024-02-22T19:04:52.929882+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123717\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123835\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}}, \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:04:53.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:53 smithi063 bash[35391]: audit 2024-02-22T19:04:52.932589+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123717\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123835\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}}, \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:04:53.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:53 smithi063 bash[35391]: audit 2024-02-22T19:04:52.933343+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:04:53.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:53 smithi063 bash[35391]: cluster 2024-02-22T19:04:53.180798+0000 mon.a (mon.0) 173 : cluster [DBG] Standby manager daemon x started 2024-02-22T19:04:53.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:53 smithi063 bash[35391]: audit 2024-02-22T19:04:53.181624+0000 mon.c (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.63:0/3778676503' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:04:53.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:53 smithi063 bash[35391]: audit 2024-02-22T19:04:53.182744+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.63:0/3778676503' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:04:53.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:53 smithi062 bash[64101]: audit 2024-02-22T19:04:52.929882+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123717\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123835\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}}, \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:04:53.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:53 smithi062 bash[64101]: audit 2024-02-22T19:04:52.932589+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123717\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:15.123835\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}}, \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:04:53.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:53 smithi062 bash[64101]: audit 2024-02-22T19:04:52.933343+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:04:53.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:53 smithi062 bash[64101]: cluster 2024-02-22T19:04:53.180798+0000 mon.a (mon.0) 173 : cluster [DBG] Standby manager daemon x started 2024-02-22T19:04:53.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:53 smithi062 bash[64101]: audit 2024-02-22T19:04:53.181624+0000 mon.c (mon.1) 3 : audit [DBG] from='mgr.? 172.21.15.63:0/3778676503' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:04:53.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:53 smithi062 bash[64101]: audit 2024-02-22T19:04:53.182744+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.63:0/3778676503' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:04:53.913 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-22T19:04:53.913 INFO:teuthology.orchestra.run.smithi062.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-22T19:04:53.913 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10+0 records in 2024-02-22T19:04:53.913 INFO:teuthology.orchestra.run.smithi062.stderr:10+0 records out 2024-02-22T19:04:53.913 INFO:teuthology.orchestra.run.smithi062.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0159094 s, 659 MB/s 2024-02-22T19:04:53.913 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping successful for: 2024-02-22T19:04:54.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:54 smithi063 bash[35391]: cluster 2024-02-22T19:04:53.442413+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:54.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:54 smithi063 bash[35391]: cluster 2024-02-22T19:04:53.941248+0000 mon.a (mon.0) 174 : cluster [DBG] mgrmap e14: y(active, since 88s), standbys: x 2024-02-22T19:04:54.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:54 smithi063 bash[35391]: audit 2024-02-22T19:04:53.941371+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T19:04:54.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:54 smithi062 bash[64101]: cluster 2024-02-22T19:04:53.442413+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:54.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:54 smithi062 bash[64101]: cluster 2024-02-22T19:04:53.941248+0000 mon.a (mon.0) 174 : cluster [DBG] mgrmap e14: y(active, since 88s), standbys: x 2024-02-22T19:04:54.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:54 smithi062 bash[64101]: audit 2024-02-22T19:04:53.941371+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T19:04:54.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:54 smithi062 bash[67442]: cluster 2024-02-22T19:04:53.442413+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:54.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:54 smithi062 bash[67442]: cluster 2024-02-22T19:04:53.941248+0000 mon.a (mon.0) 174 : cluster [DBG] mgrmap e14: y(active, since 88s), standbys: x 2024-02-22T19:04:54.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:54 smithi062 bash[67442]: audit 2024-02-22T19:04:53.941371+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T19:04:54.817 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph orch daemon add osd smithi062:vg_nvme/lv_4 2024-02-22T19:04:55.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:55 smithi063 bash[35391]: audit 2024-02-22T19:04:54.938854+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938145\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938221\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938256\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}}, \"last_daemon_update\": \"2024-02-22T19:04:54.938325\", \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:04:55.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:55 smithi063 bash[35391]: audit 2024-02-22T19:04:54.942435+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938145\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938221\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938256\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}}, \"last_daemon_update\": \"2024-02-22T19:04:54.938325\", \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:04:55.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:55 smithi062 bash[64101]: audit 2024-02-22T19:04:54.938854+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938145\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938221\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938256\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}}, \"last_daemon_update\": \"2024-02-22T19:04:54.938325\", \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:04:55.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:55 smithi062 bash[64101]: audit 2024-02-22T19:04:54.942435+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938145\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938221\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938256\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}}, \"last_daemon_update\": \"2024-02-22T19:04:54.938325\", \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:04:55.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:55 smithi062 bash[67442]: audit 2024-02-22T19:04:54.938854+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938145\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938221\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938256\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}}, \"last_daemon_update\": \"2024-02-22T19:04:54.938325\", \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:04:55.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:55 smithi062 bash[67442]: audit 2024-02-22T19:04:54.942435+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938145\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938221\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938256\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}}, \"last_daemon_update\": \"2024-02-22T19:04:54.938325\", \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:04:56.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:56 smithi063 bash[35391]: cluster 2024-02-22T19:04:55.442809+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:56.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:56 smithi062 bash[64101]: cluster 2024-02-22T19:04:55.442809+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:56.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:56 smithi062 bash[67442]: cluster 2024-02-22T19:04:55.442809+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:57.659 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:57 smithi062 bash[64101]: audit 2024-02-22T19:04:56.837026+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:04:57.659 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:57 smithi062 bash[64101]: audit 2024-02-22T19:04:56.837588+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:04:57.660 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:57 smithi062 bash[64101]: audit 2024-02-22T19:04:56.838237+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:04:57.660 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:57 smithi062 bash[67442]: audit 2024-02-22T19:04:56.837026+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:04:57.660 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:57 smithi062 bash[67442]: audit 2024-02-22T19:04:56.837588+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:04:57.660 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:57 smithi062 bash[67442]: audit 2024-02-22T19:04:56.838237+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:04:57.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:57 smithi063 bash[35391]: audit 2024-02-22T19:04:56.837026+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:04:57.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:57 smithi063 bash[35391]: audit 2024-02-22T19:04:56.837588+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:04:57.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:57 smithi063 bash[35391]: audit 2024-02-22T19:04:56.838237+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:04:58.663 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:58 smithi062 bash[64101]: audit 2024-02-22T19:04:56.835974+0000 mgr.y (mgr.14140) 51 : audit [DBG] from='client.14202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:04:58.663 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:58 smithi062 bash[64101]: cephadm 2024-02-22T19:04:56.836749+0000 mgr.y (mgr.14140) 52 : cephadm [INF] Applying osd on host smithi062... 2024-02-22T19:04:58.663 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:58 smithi062 bash[64101]: cluster 2024-02-22T19:04:57.443058+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:58.663 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:58 smithi062 bash[67442]: audit 2024-02-22T19:04:56.835974+0000 mgr.y (mgr.14140) 51 : audit [DBG] from='client.14202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:04:58.663 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:58 smithi062 bash[67442]: cephadm 2024-02-22T19:04:56.836749+0000 mgr.y (mgr.14140) 52 : cephadm [INF] Applying osd on host smithi062... 2024-02-22T19:04:58.663 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:58 smithi062 bash[67442]: cluster 2024-02-22T19:04:57.443058+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:58.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:58 smithi063 bash[35391]: audit 2024-02-22T19:04:56.835974+0000 mgr.y (mgr.14140) 51 : audit [DBG] from='client.14202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:04:58.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:58 smithi063 bash[35391]: cephadm 2024-02-22T19:04:56.836749+0000 mgr.y (mgr.14140) 52 : cephadm [INF] Applying osd on host smithi062... 2024-02-22T19:04:58.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:58 smithi063 bash[35391]: cluster 2024-02-22T19:04:57.443058+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:04:59.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:59 smithi062 bash[67442]: audit 2024-02-22T19:04:59.390405+0000 mon.a (mon.0) 181 : audit [INF] from='client.? 172.21.15.62:0/1033513703' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2"}]: dispatch 2024-02-22T19:04:59.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:59 smithi062 bash[67442]: audit 2024-02-22T19:04:59.393664+0000 mon.a (mon.0) 182 : audit [INF] from='client.? 172.21.15.62:0/1033513703' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2"}]': finished 2024-02-22T19:04:59.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:59 smithi062 bash[67442]: cluster 2024-02-22T19:04:59.393699+0000 mon.a (mon.0) 183 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2024-02-22T19:04:59.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:04:59 smithi062 bash[67442]: audit 2024-02-22T19:04:59.393781+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:04:59.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:59 smithi062 bash[64101]: audit 2024-02-22T19:04:59.390405+0000 mon.a (mon.0) 181 : audit [INF] from='client.? 172.21.15.62:0/1033513703' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2"}]: dispatch 2024-02-22T19:04:59.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:59 smithi062 bash[64101]: audit 2024-02-22T19:04:59.393664+0000 mon.a (mon.0) 182 : audit [INF] from='client.? 172.21.15.62:0/1033513703' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2"}]': finished 2024-02-22T19:04:59.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:59 smithi062 bash[64101]: cluster 2024-02-22T19:04:59.393699+0000 mon.a (mon.0) 183 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2024-02-22T19:04:59.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:04:59 smithi062 bash[64101]: audit 2024-02-22T19:04:59.393781+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:04:59.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:59 smithi063 bash[35391]: audit 2024-02-22T19:04:59.390405+0000 mon.a (mon.0) 181 : audit [INF] from='client.? 172.21.15.62:0/1033513703' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2"}]: dispatch 2024-02-22T19:04:59.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:59 smithi063 bash[35391]: audit 2024-02-22T19:04:59.393664+0000 mon.a (mon.0) 182 : audit [INF] from='client.? 172.21.15.62:0/1033513703' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2"}]': finished 2024-02-22T19:04:59.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:59 smithi063 bash[35391]: cluster 2024-02-22T19:04:59.393699+0000 mon.a (mon.0) 183 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2024-02-22T19:04:59.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:04:59 smithi063 bash[35391]: audit 2024-02-22T19:04:59.393781+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:05:00.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:00 smithi062 bash[64101]: cluster 2024-02-22T19:04:59.443377+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:00.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:00 smithi062 bash[64101]: audit 2024-02-22T19:05:00.215355+0000 mon.a (mon.0) 185 : audit [DBG] from='client.? 172.21.15.62:0/3234420932' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:05:00.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:00 smithi062 bash[67442]: cluster 2024-02-22T19:04:59.443377+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:00.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:00 smithi062 bash[67442]: audit 2024-02-22T19:05:00.215355+0000 mon.a (mon.0) 185 : audit [DBG] from='client.? 172.21.15.62:0/3234420932' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:05:00.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:00 smithi063 bash[35391]: cluster 2024-02-22T19:04:59.443377+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:00.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:00 smithi063 bash[35391]: audit 2024-02-22T19:05:00.215355+0000 mon.a (mon.0) 185 : audit [DBG] from='client.? 172.21.15.62:0/3234420932' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:05:02.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:02 smithi062 bash[64101]: cluster 2024-02-22T19:05:01.443727+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:02.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:02 smithi062 bash[67442]: cluster 2024-02-22T19:05:01.443727+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:02.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:02 smithi063 bash[35391]: cluster 2024-02-22T19:05:01.443727+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:03.656 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:03 smithi062 bash[64101]: audit 2024-02-22T19:05:02.875872+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:03.657 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:03 smithi062 bash[67442]: audit 2024-02-22T19:05:02.875872+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:03.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:03 smithi063 bash[35391]: audit 2024-02-22T19:05:02.875872+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:04.645 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:04 smithi062 bash[64101]: cluster 2024-02-22T19:05:03.444012+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:04.645 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:04 smithi062 bash[67442]: cluster 2024-02-22T19:05:03.444012+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:04.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:04 smithi063 bash[35391]: cluster 2024-02-22T19:05:03.444012+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:06.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:06 smithi063 bash[35391]: cluster 2024-02-22T19:05:05.444371+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:06.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:06 smithi063 bash[35391]: audit 2024-02-22T19:05:05.798684+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-22T19:05:06.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:06 smithi063 bash[35391]: audit 2024-02-22T19:05:05.799354+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:06.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:06 smithi063 bash[35391]: audit 2024-02-22T19:05:05.800104+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2024-02-22T19:05:06.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:06 smithi062 bash[64101]: cluster 2024-02-22T19:05:05.444371+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:06.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:06 smithi062 bash[64101]: audit 2024-02-22T19:05:05.798684+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-22T19:05:06.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:06 smithi062 bash[64101]: audit 2024-02-22T19:05:05.799354+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:06.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:06 smithi062 bash[64101]: audit 2024-02-22T19:05:05.800104+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2024-02-22T19:05:06.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:06 smithi062 bash[67442]: cluster 2024-02-22T19:05:05.444371+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:06.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:06 smithi062 bash[67442]: audit 2024-02-22T19:05:05.798684+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-22T19:05:06.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:06 smithi062 bash[67442]: audit 2024-02-22T19:05:05.799354+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:06.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:06 smithi062 bash[67442]: audit 2024-02-22T19:05:05.800104+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2024-02-22T19:05:07.466 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 0 on host 'smithi062' 2024-02-22T19:05:07.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:07 smithi063 bash[35391]: cephadm 2024-02-22T19:05:05.799875+0000 mgr.y (mgr.14140) 58 : cephadm [INF] Deploying daemon osd.0 on smithi062 2024-02-22T19:05:07.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:07 smithi062 bash[64101]: cephadm 2024-02-22T19:05:05.799875+0000 mgr.y (mgr.14140) 58 : cephadm [INF] Deploying daemon osd.0 on smithi062 2024-02-22T19:05:07.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:07 smithi062 bash[67442]: cephadm 2024-02-22T19:05:05.799875+0000 mgr.y (mgr.14140) 58 : cephadm [INF] Deploying daemon osd.0 on smithi062 2024-02-22T19:05:08.410 DEBUG:teuthology.orchestra.run.smithi062:osd.0> sudo journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.0.service 2024-02-22T19:05:08.413 INFO:tasks.cephadm:Deploying osd.1 on smithi062 with /dev/vg_nvme/lv_3... 2024-02-22T19:05:08.413 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-22T19:05:08.447 INFO:journalctl@ceph.osd.0.smithi062.stdout:-- Logs begin at Thu 2024-02-22 18:41:31 UTC. -- 2024-02-22T19:05:08.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:08 smithi063 bash[35391]: cluster 2024-02-22T19:05:07.444616+0000 mgr.y (mgr.14140) 59 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:08.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:08 smithi063 bash[35391]: audit 2024-02-22T19:05:07.457452+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938145\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938221\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938256\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}}, \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:08.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:08 smithi063 bash[35391]: audit 2024-02-22T19:05:07.457826+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:05:08.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:08 smithi063 bash[35391]: audit 2024-02-22T19:05:07.463135+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938145\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938221\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938256\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}}, \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:08.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:08 smithi062 bash[64101]: cluster 2024-02-22T19:05:07.444616+0000 mgr.y (mgr.14140) 59 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:08.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:08 smithi062 bash[67442]: cluster 2024-02-22T19:05:07.444616+0000 mgr.y (mgr.14140) 59 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:08.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:08 smithi062 bash[67442]: audit 2024-02-22T19:05:07.457452+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938145\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938221\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938256\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}}, \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:08.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:08 smithi062 bash[67442]: audit 2024-02-22T19:05:07.457826+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:05:08.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:08 smithi062 bash[67442]: audit 2024-02-22T19:05:07.463135+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938145\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938221\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938256\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}}, \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:08.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:08 smithi062 bash[64101]: audit 2024-02-22T19:05:07.457452+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938145\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938221\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938256\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}}, \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:08.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:08 smithi062 bash[64101]: audit 2024-02-22T19:05:07.457826+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:05:08.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:08 smithi062 bash[64101]: audit 2024-02-22T19:05:07.463135+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938145\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938221\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:54.938256\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}}, \"last_device_update\": \"2024-02-22T19:03:33.819409\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:09.337 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:05:09 smithi062 bash[69513]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-22T19:05:09.337 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:05:09 smithi062 bash[69513]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-02-22T19:05:09.337 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:05:09 smithi062 bash[69513]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-22T19:05:09.337 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:05:09 smithi062 bash[69513]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-02-22T19:05:09.337 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:05:09 smithi062 bash[69513]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-22T19:05:09.337 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:05:09 smithi062 bash[69513]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-22T19:05:09.337 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:05:09 smithi062 bash[69513]: --> ceph-volume lvm activate successful for osd ID: 0 2024-02-22T19:05:10.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:10 smithi062 bash[64101]: cluster 2024-02-22T19:05:09.444888+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:10.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:10 smithi062 bash[67442]: cluster 2024-02-22T19:05:09.444888+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:10.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:10 smithi063 bash[35391]: cluster 2024-02-22T19:05:09.444888+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:11.501 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:05:11 smithi062 bash[69823]: debug 2024-02-22T19:05:11.238+0000 7fdfe62acec0 -1 Falling back to public interface 2024-02-22T19:05:11.793 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:11 smithi062 bash[64101]: audit 2024-02-22T19:05:10.944177+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.942949\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943067\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943140\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943216\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}}, \"last_daemon_update\": \"2024-02-22T19:05:10.943355\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:11.793 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:11 smithi062 bash[67442]: audit 2024-02-22T19:05:10.944177+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.942949\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943067\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943140\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943216\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}}, \"last_daemon_update\": \"2024-02-22T19:05:10.943355\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:11.793 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:11 smithi062 bash[64101]: audit 2024-02-22T19:05:10.946958+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.942949\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943067\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943140\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943216\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}}, \"last_daemon_update\": \"2024-02-22T19:05:10.943355\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:11.794 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:11 smithi062 bash[64101]: audit 2024-02-22T19:05:10.947600+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:11.794 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:11 smithi062 bash[67442]: audit 2024-02-22T19:05:10.946958+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.942949\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943067\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943140\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943216\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}}, \"last_daemon_update\": \"2024-02-22T19:05:10.943355\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:11.794 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:11 smithi062 bash[67442]: audit 2024-02-22T19:05:10.947600+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:11.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:11 smithi063 bash[35391]: audit 2024-02-22T19:05:10.944177+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.942949\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943067\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943140\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943216\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}}, \"last_daemon_update\": \"2024-02-22T19:05:10.943355\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:11.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:11 smithi063 bash[35391]: audit 2024-02-22T19:05:10.946958+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.942949\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943067\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943140\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943216\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}}, \"last_daemon_update\": \"2024-02-22T19:05:10.943355\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:11.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:11 smithi063 bash[35391]: audit 2024-02-22T19:05:10.947600+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:12.234 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:05:11 smithi062 bash[69823]: debug 2024-02-22T19:05:11.791+0000 7fdfe62acec0 -1 osd.0 0 log_to_monitors {default=true} 2024-02-22T19:05:12.876 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:12 smithi062 bash[64101]: cluster 2024-02-22T19:05:11.445217+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:12.876 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:12 smithi062 bash[64101]: audit 2024-02-22T19:05:11.795307+0000 mon.a (mon.0) 196 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/3658961562,v1:172.21.15.62:6803/3658961562]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-22T19:05:12.876 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:12 smithi062 bash[67442]: cluster 2024-02-22T19:05:11.445217+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:12.877 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:12 smithi062 bash[67442]: audit 2024-02-22T19:05:11.795307+0000 mon.a (mon.0) 196 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/3658961562,v1:172.21.15.62:6803/3658961562]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-22T19:05:12.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:12 smithi063 bash[35391]: cluster 2024-02-22T19:05:11.445217+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:12.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:12 smithi063 bash[35391]: audit 2024-02-22T19:05:11.795307+0000 mon.a (mon.0) 196 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/3658961562,v1:172.21.15.62:6803/3658961562]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-22T19:05:13.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:13 smithi062 bash[64101]: audit 2024-02-22T19:05:12.504081+0000 mon.a (mon.0) 197 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/3658961562,v1:172.21.15.62:6803/3658961562]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-22T19:05:13.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:13 smithi062 bash[64101]: cluster 2024-02-22T19:05:12.504123+0000 mon.a (mon.0) 198 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2024-02-22T19:05:13.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:13 smithi062 bash[64101]: audit 2024-02-22T19:05:12.504559+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:05:13.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:13 smithi062 bash[64101]: audit 2024-02-22T19:05:12.504933+0000 mon.a (mon.0) 200 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/3658961562,v1:172.21.15.62:6803/3658961562]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-22T19:05:13.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:13 smithi062 bash[67442]: audit 2024-02-22T19:05:12.504081+0000 mon.a (mon.0) 197 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/3658961562,v1:172.21.15.62:6803/3658961562]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-22T19:05:13.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:13 smithi062 bash[67442]: cluster 2024-02-22T19:05:12.504123+0000 mon.a (mon.0) 198 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2024-02-22T19:05:13.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:13 smithi062 bash[67442]: audit 2024-02-22T19:05:12.504559+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:05:13.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:13 smithi062 bash[67442]: audit 2024-02-22T19:05:12.504933+0000 mon.a (mon.0) 200 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/3658961562,v1:172.21.15.62:6803/3658961562]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-22T19:05:13.736 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:05:13 smithi062 bash[69823]: debug 2024-02-22T19:05:13.509+0000 7fdfcb059700 -1 osd.0 0 waiting for initial osdmap 2024-02-22T19:05:13.736 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:05:13 smithi062 bash[69823]: debug 2024-02-22T19:05:13.517+0000 7fdfd6275700 -1 osd.0 9 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-22T19:05:13.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:13 smithi063 bash[35391]: audit 2024-02-22T19:05:12.504081+0000 mon.a (mon.0) 197 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/3658961562,v1:172.21.15.62:6803/3658961562]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-22T19:05:13.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:13 smithi063 bash[35391]: cluster 2024-02-22T19:05:12.504123+0000 mon.a (mon.0) 198 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2024-02-22T19:05:13.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:13 smithi063 bash[35391]: audit 2024-02-22T19:05:12.504559+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:05:13.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:13 smithi063 bash[35391]: audit 2024-02-22T19:05:12.504933+0000 mon.a (mon.0) 200 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/3658961562,v1:172.21.15.62:6803/3658961562]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-22T19:05:14.402 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-22T19:05:14.403 INFO:teuthology.orchestra.run.smithi062.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-22T19:05:14.403 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10+0 records in 2024-02-22T19:05:14.403 INFO:teuthology.orchestra.run.smithi062.stderr:10+0 records out 2024-02-22T19:05:14.403 INFO:teuthology.orchestra.run.smithi062.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122319 s, 857 MB/s 2024-02-22T19:05:14.403 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping successful for: 2024-02-22T19:05:14.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:14 smithi062 bash[64101]: cluster 2024-02-22T19:05:12.793886+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:05:14.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:14 smithi062 bash[64101]: cluster 2024-02-22T19:05:12.793920+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:05:14.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:14 smithi062 bash[64101]: cluster 2024-02-22T19:05:13.445509+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:14.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:14 smithi062 bash[64101]: audit 2024-02-22T19:05:13.506629+0000 mon.a (mon.0) 201 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/3658961562,v1:172.21.15.62:6803/3658961562]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-22T19:05:14.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:14 smithi062 bash[64101]: cluster 2024-02-22T19:05:13.506677+0000 mon.a (mon.0) 202 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2024-02-22T19:05:14.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:14 smithi062 bash[64101]: audit 2024-02-22T19:05:13.506808+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:05:14.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:14 smithi062 bash[67442]: cluster 2024-02-22T19:05:12.793886+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:05:14.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:14 smithi062 bash[67442]: cluster 2024-02-22T19:05:12.793920+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:05:14.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:14 smithi062 bash[67442]: cluster 2024-02-22T19:05:13.445509+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:14.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:14 smithi062 bash[67442]: audit 2024-02-22T19:05:13.506629+0000 mon.a (mon.0) 201 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/3658961562,v1:172.21.15.62:6803/3658961562]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-22T19:05:14.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:14 smithi062 bash[67442]: cluster 2024-02-22T19:05:13.506677+0000 mon.a (mon.0) 202 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2024-02-22T19:05:14.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:14 smithi062 bash[67442]: audit 2024-02-22T19:05:13.506808+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:05:14.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:14 smithi063 bash[35391]: cluster 2024-02-22T19:05:12.793886+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:05:14.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:14 smithi063 bash[35391]: cluster 2024-02-22T19:05:12.793920+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:05:14.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:14 smithi063 bash[35391]: cluster 2024-02-22T19:05:13.445509+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:14.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:14 smithi063 bash[35391]: audit 2024-02-22T19:05:13.506629+0000 mon.a (mon.0) 201 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/3658961562,v1:172.21.15.62:6803/3658961562]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-22T19:05:14.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:14 smithi063 bash[35391]: cluster 2024-02-22T19:05:13.506677+0000 mon.a (mon.0) 202 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2024-02-22T19:05:14.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:14 smithi063 bash[35391]: audit 2024-02-22T19:05:13.506808+0000 mon.a (mon.0) 203 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:05:15.317 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph orch daemon add osd smithi062:vg_nvme/lv_3 2024-02-22T19:05:15.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:15 smithi062 bash[64101]: cluster 2024-02-22T19:05:14.519040+0000 mon.a (mon.0) 204 : cluster [INF] osd.0 [v2:172.21.15.62:6802/3658961562,v1:172.21.15.62:6803/3658961562] boot 2024-02-22T19:05:15.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:15 smithi062 bash[64101]: cluster 2024-02-22T19:05:14.519081+0000 mon.a (mon.0) 205 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-02-22T19:05:15.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:15 smithi062 bash[64101]: audit 2024-02-22T19:05:14.519614+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:05:15.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:15 smithi062 bash[64101]: cluster 2024-02-22T19:05:15.520296+0000 mon.a (mon.0) 207 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2024-02-22T19:05:15.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:15 smithi062 bash[67442]: cluster 2024-02-22T19:05:14.519040+0000 mon.a (mon.0) 204 : cluster [INF] osd.0 [v2:172.21.15.62:6802/3658961562,v1:172.21.15.62:6803/3658961562] boot 2024-02-22T19:05:15.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:15 smithi062 bash[67442]: cluster 2024-02-22T19:05:14.519081+0000 mon.a (mon.0) 205 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-02-22T19:05:15.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:15 smithi062 bash[67442]: audit 2024-02-22T19:05:14.519614+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:05:15.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:15 smithi062 bash[67442]: cluster 2024-02-22T19:05:15.520296+0000 mon.a (mon.0) 207 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2024-02-22T19:05:15.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:15 smithi063 bash[35391]: cluster 2024-02-22T19:05:14.519040+0000 mon.a (mon.0) 204 : cluster [INF] osd.0 [v2:172.21.15.62:6802/3658961562,v1:172.21.15.62:6803/3658961562] boot 2024-02-22T19:05:15.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:15 smithi063 bash[35391]: cluster 2024-02-22T19:05:14.519081+0000 mon.a (mon.0) 205 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-02-22T19:05:15.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:15 smithi063 bash[35391]: audit 2024-02-22T19:05:14.519614+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:05:15.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:15 smithi063 bash[35391]: cluster 2024-02-22T19:05:15.520296+0000 mon.a (mon.0) 207 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2024-02-22T19:05:16.816 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:16 smithi062 bash[64101]: cluster 2024-02-22T19:05:15.445815+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:16.816 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:16 smithi062 bash[64101]: audit 2024-02-22T19:05:15.768440+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:05:16.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:16 smithi062 bash[67442]: cluster 2024-02-22T19:05:15.445815+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:16.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:16 smithi062 bash[67442]: audit 2024-02-22T19:05:15.768440+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:05:16.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:16 smithi062 bash[64101]: audit 2024-02-22T19:05:15.980834+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.942949\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943067\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943140\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943216\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}}, \"last_daemon_update\": \"2024-02-22T19:05:10.943355\", \"last_device_update\": \"2024-02-22T19:05:15.980263\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:16.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:16 smithi062 bash[64101]: audit 2024-02-22T19:05:15.983491+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.942949\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943067\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943140\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943216\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}}, \"last_daemon_update\": \"2024-02-22T19:05:10.943355\", \"last_device_update\": \"2024-02-22T19:05:15.980263\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:16.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:16 smithi062 bash[64101]: cluster 2024-02-22T19:05:16.520822+0000 mon.a (mon.0) 211 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2024-02-22T19:05:16.817 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:16 smithi062 bash[67442]: audit 2024-02-22T19:05:15.980834+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.942949\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943067\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943140\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943216\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}}, \"last_daemon_update\": \"2024-02-22T19:05:10.943355\", \"last_device_update\": \"2024-02-22T19:05:15.980263\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:16.817 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:16 smithi062 bash[67442]: audit 2024-02-22T19:05:15.983491+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.942949\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943067\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943140\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943216\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}}, \"last_daemon_update\": \"2024-02-22T19:05:10.943355\", \"last_device_update\": \"2024-02-22T19:05:15.980263\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:16.817 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:16 smithi062 bash[67442]: cluster 2024-02-22T19:05:16.520822+0000 mon.a (mon.0) 211 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2024-02-22T19:05:16.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:16 smithi063 bash[35391]: cluster 2024-02-22T19:05:15.445815+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-22T19:05:16.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:16 smithi063 bash[35391]: audit 2024-02-22T19:05:15.768440+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:05:16.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:16 smithi063 bash[35391]: audit 2024-02-22T19:05:15.980834+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.942949\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943067\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943140\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943216\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}}, \"last_daemon_update\": \"2024-02-22T19:05:10.943355\", \"last_device_update\": \"2024-02-22T19:05:15.980263\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:16.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:16 smithi063 bash[35391]: audit 2024-02-22T19:05:15.983491+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.942949\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943067\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943140\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943216\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}}, \"last_daemon_update\": \"2024-02-22T19:05:10.943355\", \"last_device_update\": \"2024-02-22T19:05:15.980263\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:16.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:16 smithi063 bash[35391]: cluster 2024-02-22T19:05:16.520822+0000 mon.a (mon.0) 211 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2024-02-22T19:05:17.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:17 smithi062 bash[64101]: cluster 2024-02-22T19:05:17.446136+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v56: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:17.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:17 smithi062 bash[64101]: cluster 2024-02-22T19:05:17.527375+0000 mon.a (mon.0) 212 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-22T19:05:17.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:17 smithi062 bash[67442]: cluster 2024-02-22T19:05:17.446136+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v56: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:17.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:17 smithi062 bash[67442]: cluster 2024-02-22T19:05:17.527375+0000 mon.a (mon.0) 212 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-22T19:05:17.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:17 smithi063 bash[35391]: cluster 2024-02-22T19:05:17.446136+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v56: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:17.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:17 smithi063 bash[35391]: cluster 2024-02-22T19:05:17.527375+0000 mon.a (mon.0) 212 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-22T19:05:18.918 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:18 smithi062 bash[64101]: audit 2024-02-22T19:05:17.890315+0000 mgr.y (mgr.14140) 65 : audit [DBG] from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:05:18.918 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:18 smithi062 bash[64101]: cephadm 2024-02-22T19:05:17.890879+0000 mgr.y (mgr.14140) 66 : cephadm [INF] Applying osd on host smithi062... 2024-02-22T19:05:18.918 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:18 smithi062 bash[64101]: audit 2024-02-22T19:05:17.891129+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:05:18.918 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:18 smithi062 bash[64101]: audit 2024-02-22T19:05:17.891689+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:18.918 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:18 smithi062 bash[64101]: audit 2024-02-22T19:05:17.892401+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:18.918 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:18 smithi062 bash[67442]: audit 2024-02-22T19:05:17.890315+0000 mgr.y (mgr.14140) 65 : audit [DBG] from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:05:18.918 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:18 smithi062 bash[67442]: cephadm 2024-02-22T19:05:17.890879+0000 mgr.y (mgr.14140) 66 : cephadm [INF] Applying osd on host smithi062... 2024-02-22T19:05:18.918 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:18 smithi062 bash[67442]: audit 2024-02-22T19:05:17.891129+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:05:18.919 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:18 smithi062 bash[67442]: audit 2024-02-22T19:05:17.891689+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:18.919 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:18 smithi062 bash[67442]: audit 2024-02-22T19:05:17.892401+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:18.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:18 smithi063 bash[35391]: audit 2024-02-22T19:05:17.890315+0000 mgr.y (mgr.14140) 65 : audit [DBG] from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:05:18.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:18 smithi063 bash[35391]: cephadm 2024-02-22T19:05:17.890879+0000 mgr.y (mgr.14140) 66 : cephadm [INF] Applying osd on host smithi062... 2024-02-22T19:05:18.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:18 smithi063 bash[35391]: audit 2024-02-22T19:05:17.891129+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:05:18.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:18 smithi063 bash[35391]: audit 2024-02-22T19:05:17.891689+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:18.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:18 smithi063 bash[35391]: audit 2024-02-22T19:05:17.892401+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:19.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:19 smithi063 bash[35391]: cluster 2024-02-22T19:05:19.446506+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v57: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:19.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:19 smithi062 bash[64101]: cluster 2024-02-22T19:05:19.446506+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v57: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:19.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:19 smithi062 bash[67442]: cluster 2024-02-22T19:05:19.446506+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v57: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:20.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:20 smithi063 bash[35391]: audit 2024-02-22T19:05:20.120403+0000 mon.a (mon.0) 216 : audit [INF] from='client.? 172.21.15.62:0/2792216828' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85b86909-3c43-46e4-8bc0-d4d3f86cb85a"}]: dispatch 2024-02-22T19:05:20.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:20 smithi063 bash[35391]: audit 2024-02-22T19:05:20.126376+0000 mon.a (mon.0) 217 : audit [INF] from='client.? 172.21.15.62:0/2792216828' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85b86909-3c43-46e4-8bc0-d4d3f86cb85a"}]': finished 2024-02-22T19:05:20.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:20 smithi063 bash[35391]: cluster 2024-02-22T19:05:20.126412+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2024-02-22T19:05:20.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:20 smithi063 bash[35391]: audit 2024-02-22T19:05:20.126530+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:05:20.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:20 smithi062 bash[64101]: audit 2024-02-22T19:05:20.120403+0000 mon.a (mon.0) 216 : audit [INF] from='client.? 172.21.15.62:0/2792216828' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85b86909-3c43-46e4-8bc0-d4d3f86cb85a"}]: dispatch 2024-02-22T19:05:20.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:20 smithi062 bash[64101]: audit 2024-02-22T19:05:20.126376+0000 mon.a (mon.0) 217 : audit [INF] from='client.? 172.21.15.62:0/2792216828' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85b86909-3c43-46e4-8bc0-d4d3f86cb85a"}]': finished 2024-02-22T19:05:20.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:20 smithi062 bash[64101]: cluster 2024-02-22T19:05:20.126412+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2024-02-22T19:05:20.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:20 smithi062 bash[64101]: audit 2024-02-22T19:05:20.126530+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:05:20.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:20 smithi062 bash[67442]: audit 2024-02-22T19:05:20.120403+0000 mon.a (mon.0) 216 : audit [INF] from='client.? 172.21.15.62:0/2792216828' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "85b86909-3c43-46e4-8bc0-d4d3f86cb85a"}]: dispatch 2024-02-22T19:05:20.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:20 smithi062 bash[67442]: audit 2024-02-22T19:05:20.126376+0000 mon.a (mon.0) 217 : audit [INF] from='client.? 172.21.15.62:0/2792216828' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "85b86909-3c43-46e4-8bc0-d4d3f86cb85a"}]': finished 2024-02-22T19:05:20.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:20 smithi062 bash[67442]: cluster 2024-02-22T19:05:20.126412+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2024-02-22T19:05:20.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:20 smithi062 bash[67442]: audit 2024-02-22T19:05:20.126530+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:05:21.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:21 smithi063 bash[35391]: audit 2024-02-22T19:05:20.872889+0000 mon.a (mon.0) 220 : audit [DBG] from='client.? 172.21.15.62:0/729635861' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:05:21.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:21 smithi063 bash[35391]: cluster 2024-02-22T19:05:21.446846+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:21.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:21 smithi062 bash[64101]: audit 2024-02-22T19:05:20.872889+0000 mon.a (mon.0) 220 : audit [DBG] from='client.? 172.21.15.62:0/729635861' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:05:21.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:21 smithi062 bash[64101]: cluster 2024-02-22T19:05:21.446846+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:21.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:21 smithi062 bash[67442]: audit 2024-02-22T19:05:20.872889+0000 mon.a (mon.0) 220 : audit [DBG] from='client.? 172.21.15.62:0/729635861' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:05:21.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:21 smithi062 bash[67442]: cluster 2024-02-22T19:05:21.446846+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:24.955 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:24 smithi062 bash[64101]: cluster 2024-02-22T19:05:23.447356+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:24.955 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:24 smithi062 bash[64101]: audit 2024-02-22T19:05:23.645453+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:24.956 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:24 smithi062 bash[67442]: cluster 2024-02-22T19:05:23.447356+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:24.956 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:24 smithi062 bash[67442]: audit 2024-02-22T19:05:23.645453+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:24.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:24 smithi063 bash[35391]: cluster 2024-02-22T19:05:23.447356+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:24.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:24 smithi063 bash[35391]: audit 2024-02-22T19:05:23.645453+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:25.897 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:25 smithi062 bash[64101]: cluster 2024-02-22T19:05:25.417568+0000 mon.a (mon.0) 222 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-22T19:05:25.897 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:25 smithi062 bash[67442]: cluster 2024-02-22T19:05:25.417568+0000 mon.a (mon.0) 222 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-22T19:05:25.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:25 smithi063 bash[35391]: cluster 2024-02-22T19:05:25.417568+0000 mon.a (mon.0) 222 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-22T19:05:26.872 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:26 smithi062 bash[64101]: cluster 2024-02-22T19:05:25.447672+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v61: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:26.872 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:26 smithi062 bash[64101]: audit 2024-02-22T19:05:26.213436+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-22T19:05:26.872 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:26 smithi062 bash[64101]: audit 2024-02-22T19:05:26.214011+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:26.873 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:26 smithi062 bash[64101]: audit 2024-02-22T19:05:26.214627+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2024-02-22T19:05:26.873 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:26 smithi062 bash[67442]: cluster 2024-02-22T19:05:25.447672+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v61: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:26.873 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:26 smithi062 bash[67442]: audit 2024-02-22T19:05:26.213436+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-22T19:05:26.873 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:26 smithi062 bash[67442]: audit 2024-02-22T19:05:26.214011+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:26.873 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:26 smithi062 bash[67442]: audit 2024-02-22T19:05:26.214627+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2024-02-22T19:05:26.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:26 smithi063 bash[35391]: cluster 2024-02-22T19:05:25.447672+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v61: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:26.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:26 smithi063 bash[35391]: audit 2024-02-22T19:05:26.213436+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-22T19:05:26.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:26 smithi063 bash[35391]: audit 2024-02-22T19:05:26.214011+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:26.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:26 smithi063 bash[35391]: audit 2024-02-22T19:05:26.214627+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2024-02-22T19:05:27.803 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:27 smithi062 bash[64101]: cephadm 2024-02-22T19:05:26.214426+0000 mgr.y (mgr.14140) 71 : cephadm [INF] Deploying daemon osd.1 on smithi062 2024-02-22T19:05:27.804 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:27 smithi062 bash[67442]: cephadm 2024-02-22T19:05:26.214426+0000 mgr.y (mgr.14140) 71 : cephadm [INF] Deploying daemon osd.1 on smithi062 2024-02-22T19:05:27.875 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 1 on host 'smithi062' 2024-02-22T19:05:27.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:27 smithi063 bash[35391]: cephadm 2024-02-22T19:05:26.214426+0000 mgr.y (mgr.14140) 71 : cephadm [INF] Deploying daemon osd.1 on smithi062 2024-02-22T19:05:28.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:28 smithi063 bash[35391]: cluster 2024-02-22T19:05:27.448023+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v62: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:28.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:28 smithi063 bash[35391]: audit 2024-02-22T19:05:27.867609+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.942949\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943067\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943140\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943216\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}}, \"last_device_update\": \"2024-02-22T19:05:15.980263\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:28.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:28 smithi063 bash[35391]: audit 2024-02-22T19:05:27.868157+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:05:28.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:28 smithi063 bash[35391]: audit 2024-02-22T19:05:27.870951+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.942949\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943067\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943140\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943216\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}}, \"last_device_update\": \"2024-02-22T19:05:15.980263\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:28.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:28 smithi062 bash[64101]: cluster 2024-02-22T19:05:27.448023+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v62: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:28.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:28 smithi062 bash[67442]: cluster 2024-02-22T19:05:27.448023+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v62: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:28.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:28 smithi062 bash[64101]: audit 2024-02-22T19:05:27.867609+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.942949\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943067\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943140\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943216\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}}, \"last_device_update\": \"2024-02-22T19:05:15.980263\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:28.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:28 smithi062 bash[64101]: audit 2024-02-22T19:05:27.868157+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:05:28.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:28 smithi062 bash[64101]: audit 2024-02-22T19:05:27.870951+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.942949\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943067\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943140\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943216\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}}, \"last_device_update\": \"2024-02-22T19:05:15.980263\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:28.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:28 smithi062 bash[67442]: audit 2024-02-22T19:05:27.867609+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.942949\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943067\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943140\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943216\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}}, \"last_device_update\": \"2024-02-22T19:05:15.980263\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:28.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:28 smithi062 bash[67442]: audit 2024-02-22T19:05:27.868157+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:05:28.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:28 smithi062 bash[67442]: audit 2024-02-22T19:05:27.870951+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.942949\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943067\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943140\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:10.943216\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}}, \"last_device_update\": \"2024-02-22T19:05:15.980263\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:29.041 DEBUG:teuthology.orchestra.run.smithi062:osd.1> sudo journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.1.service 2024-02-22T19:05:29.043 INFO:tasks.cephadm:Deploying osd.2 on smithi062 with /dev/vg_nvme/lv_2... 2024-02-22T19:05:29.043 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-22T19:05:29.073 INFO:journalctl@ceph.osd.1.smithi062.stdout:-- Logs begin at Thu 2024-02-22 18:41:31 UTC. -- 2024-02-22T19:05:30.827 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:30 smithi062 bash[64101]: cluster 2024-02-22T19:05:29.448262+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v63: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:30.827 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:30 smithi062 bash[67442]: cluster 2024-02-22T19:05:29.448262+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v63: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:30.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:30 smithi063 bash[35391]: cluster 2024-02-22T19:05:29.448262+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v63: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:31.093 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 22 19:05:30 smithi062 bash[71255]: debug 2024-02-22T19:05:30.744+0000 7f4122ca9ec0 1 -- 172.21.15.62:0/709908873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ba76466c00 msgr2=0x55ba76463680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-22T19:05:31.093 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 22 19:05:30 smithi062 bash[71255]: debug 2024-02-22T19:05:30.744+0000 7f4122ca9ec0 1 --2- 172.21.15.62:0/709908873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55ba76466c00 0x55ba76463680 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x55ba763f9d10 tx=0x55ba770d2aa0).stop 2024-02-22T19:05:31.714 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 22 19:05:31 smithi062 bash[71255]: debug 2024-02-22T19:05:31.274+0000 7f4122ca9ec0 -1 Falling back to public interface 2024-02-22T19:05:31.729 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-22T19:05:31.729 INFO:teuthology.orchestra.run.smithi062.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-22T19:05:31.729 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10+0 records in 2024-02-22T19:05:31.729 INFO:teuthology.orchestra.run.smithi062.stderr:10+0 records out 2024-02-22T19:05:31.729 INFO:teuthology.orchestra.run.smithi062.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0153649 s, 682 MB/s 2024-02-22T19:05:31.729 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping successful for: 2024-02-22T19:05:31.984 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 22 19:05:31 smithi062 bash[71255]: debug 2024-02-22T19:05:31.842+0000 7f4122ca9ec0 -1 osd.1 0 log_to_monitors {default=true} 2024-02-22T19:05:32.469 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph orch daemon add osd smithi062:vg_nvme/lv_2 2024-02-22T19:05:32.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:32 smithi062 bash[67442]: cluster 2024-02-22T19:05:31.448518+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v64: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:32.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:32 smithi062 bash[67442]: audit 2024-02-22T19:05:31.845806+0000 mon.a (mon.0) 229 : audit [INF] from='osd.1 [v2:172.21.15.62:6810/1958140073,v1:172.21.15.62:6811/1958140073]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-22T19:05:32.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:32 smithi062 bash[64101]: cluster 2024-02-22T19:05:31.448518+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v64: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:32.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:32 smithi062 bash[64101]: audit 2024-02-22T19:05:31.845806+0000 mon.a (mon.0) 229 : audit [INF] from='osd.1 [v2:172.21.15.62:6810/1958140073,v1:172.21.15.62:6811/1958140073]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-22T19:05:32.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:32 smithi063 bash[35391]: cluster 2024-02-22T19:05:31.448518+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v64: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:32.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:32 smithi063 bash[35391]: audit 2024-02-22T19:05:31.845806+0000 mon.a (mon.0) 229 : audit [INF] from='osd.1 [v2:172.21.15.62:6810/1958140073,v1:172.21.15.62:6811/1958140073]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-22T19:05:33.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:33 smithi063 bash[35391]: audit 2024-02-22T19:05:32.523123+0000 mon.a (mon.0) 230 : audit [INF] from='osd.1 [v2:172.21.15.62:6810/1958140073,v1:172.21.15.62:6811/1958140073]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-22T19:05:33.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:33 smithi063 bash[35391]: cluster 2024-02-22T19:05:32.523164+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2024-02-22T19:05:33.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:33 smithi063 bash[35391]: audit 2024-02-22T19:05:32.523737+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:05:33.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:33 smithi063 bash[35391]: audit 2024-02-22T19:05:32.524089+0000 mon.a (mon.0) 233 : audit [INF] from='osd.1 [v2:172.21.15.62:6810/1958140073,v1:172.21.15.62:6811/1958140073]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-22T19:05:33.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:33 smithi063 bash[35391]: audit 2024-02-22T19:05:32.644731+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643834\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643909\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643943\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643973\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.644002\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}}, \"last_daemon_update\": \"2024-02-22T19:05:32.644073\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:33.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:33 smithi063 bash[35391]: audit 2024-02-22T19:05:32.648491+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643834\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643909\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643943\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643973\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.644002\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}}, \"last_daemon_update\": \"2024-02-22T19:05:32.644073\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:33.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:33 smithi063 bash[35391]: audit 2024-02-22T19:05:32.649118+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:33.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:33 smithi063 bash[35391]: audit 2024-02-22T19:05:33.519369+0000 mon.a (mon.0) 237 : audit [INF] from='osd.1 [v2:172.21.15.62:6810/1958140073,v1:172.21.15.62:6811/1958140073]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-22T19:05:33.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:33 smithi063 bash[35391]: cluster 2024-02-22T19:05:33.519406+0000 mon.a (mon.0) 238 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2024-02-22T19:05:33.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:33 smithi063 bash[35391]: audit 2024-02-22T19:05:33.519562+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:05:33.985 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[71255]: debug 2024-02-22T19:05:33.521+0000 7f4107a56700 -1 osd.1 0 waiting for initial osdmap 2024-02-22T19:05:33.985 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[71255]: debug 2024-02-22T19:05:33.524+0000 7f4112c72700 -1 osd.1 15 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-22T19:05:33.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[64101]: audit 2024-02-22T19:05:32.523123+0000 mon.a (mon.0) 230 : audit [INF] from='osd.1 [v2:172.21.15.62:6810/1958140073,v1:172.21.15.62:6811/1958140073]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-22T19:05:33.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[64101]: cluster 2024-02-22T19:05:32.523164+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2024-02-22T19:05:33.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[64101]: audit 2024-02-22T19:05:32.523737+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:05:33.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[64101]: audit 2024-02-22T19:05:32.524089+0000 mon.a (mon.0) 233 : audit [INF] from='osd.1 [v2:172.21.15.62:6810/1958140073,v1:172.21.15.62:6811/1958140073]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-22T19:05:33.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[64101]: audit 2024-02-22T19:05:32.644731+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643834\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643909\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643943\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643973\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.644002\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}}, \"last_daemon_update\": \"2024-02-22T19:05:32.644073\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:33.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[64101]: audit 2024-02-22T19:05:32.648491+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643834\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643909\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643943\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643973\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.644002\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}}, \"last_daemon_update\": \"2024-02-22T19:05:32.644073\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:33.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[64101]: audit 2024-02-22T19:05:32.649118+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:33.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[64101]: audit 2024-02-22T19:05:33.519369+0000 mon.a (mon.0) 237 : audit [INF] from='osd.1 [v2:172.21.15.62:6810/1958140073,v1:172.21.15.62:6811/1958140073]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-22T19:05:33.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[64101]: cluster 2024-02-22T19:05:33.519406+0000 mon.a (mon.0) 238 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2024-02-22T19:05:33.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[64101]: audit 2024-02-22T19:05:33.519562+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:05:33.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[67442]: audit 2024-02-22T19:05:32.523123+0000 mon.a (mon.0) 230 : audit [INF] from='osd.1 [v2:172.21.15.62:6810/1958140073,v1:172.21.15.62:6811/1958140073]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-22T19:05:33.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[67442]: cluster 2024-02-22T19:05:32.523164+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2024-02-22T19:05:33.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[67442]: audit 2024-02-22T19:05:32.523737+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:05:33.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[67442]: audit 2024-02-22T19:05:32.524089+0000 mon.a (mon.0) 233 : audit [INF] from='osd.1 [v2:172.21.15.62:6810/1958140073,v1:172.21.15.62:6811/1958140073]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-22T19:05:33.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[67442]: audit 2024-02-22T19:05:32.644731+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643834\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643909\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643943\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643973\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.644002\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}}, \"last_daemon_update\": \"2024-02-22T19:05:32.644073\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:33.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[67442]: audit 2024-02-22T19:05:32.648491+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643834\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643909\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643943\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643973\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.644002\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}}, \"last_daemon_update\": \"2024-02-22T19:05:32.644073\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:33.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[67442]: audit 2024-02-22T19:05:32.649118+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:33.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[67442]: audit 2024-02-22T19:05:33.519369+0000 mon.a (mon.0) 237 : audit [INF] from='osd.1 [v2:172.21.15.62:6810/1958140073,v1:172.21.15.62:6811/1958140073]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-22T19:05:33.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[67442]: cluster 2024-02-22T19:05:33.519406+0000 mon.a (mon.0) 238 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2024-02-22T19:05:33.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:33 smithi062 bash[67442]: audit 2024-02-22T19:05:33.519562+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:05:34.678 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:34 smithi062 bash[64101]: cluster 2024-02-22T19:05:32.884765+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:05:34.678 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:34 smithi062 bash[64101]: cluster 2024-02-22T19:05:32.884825+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:05:34.678 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:34 smithi062 bash[64101]: cluster 2024-02-22T19:05:33.448801+0000 mgr.y (mgr.14140) 75 : cluster [DBG] pgmap v66: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:34.679 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:34 smithi062 bash[67442]: cluster 2024-02-22T19:05:32.884765+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:05:34.679 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:34 smithi062 bash[67442]: cluster 2024-02-22T19:05:32.884825+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:05:34.679 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:34 smithi062 bash[67442]: cluster 2024-02-22T19:05:33.448801+0000 mgr.y (mgr.14140) 75 : cluster [DBG] pgmap v66: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:34.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:34 smithi063 bash[35391]: cluster 2024-02-22T19:05:32.884765+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:05:34.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:34 smithi063 bash[35391]: cluster 2024-02-22T19:05:32.884825+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:05:34.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:34 smithi063 bash[35391]: cluster 2024-02-22T19:05:33.448801+0000 mgr.y (mgr.14140) 75 : cluster [DBG] pgmap v66: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:35.936 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:35 smithi062 bash[64101]: cluster 2024-02-22T19:05:34.536574+0000 mon.a (mon.0) 240 : cluster [INF] osd.1 [v2:172.21.15.62:6810/1958140073,v1:172.21.15.62:6811/1958140073] boot 2024-02-22T19:05:35.936 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:35 smithi062 bash[64101]: cluster 2024-02-22T19:05:34.536620+0000 mon.a (mon.0) 241 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2024-02-22T19:05:35.936 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:35 smithi062 bash[64101]: audit 2024-02-22T19:05:34.537668+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:05:35.936 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:35 smithi062 bash[64101]: audit 2024-02-22T19:05:35.481198+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:05:35.936 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:35 smithi062 bash[64101]: audit 2024-02-22T19:05:35.481745+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:35.936 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:35 smithi062 bash[64101]: audit 2024-02-22T19:05:35.482460+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:35.936 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:35 smithi062 bash[67442]: cluster 2024-02-22T19:05:34.536574+0000 mon.a (mon.0) 240 : cluster [INF] osd.1 [v2:172.21.15.62:6810/1958140073,v1:172.21.15.62:6811/1958140073] boot 2024-02-22T19:05:35.936 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:35 smithi062 bash[67442]: cluster 2024-02-22T19:05:34.536620+0000 mon.a (mon.0) 241 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2024-02-22T19:05:35.937 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:35 smithi062 bash[67442]: audit 2024-02-22T19:05:34.537668+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:05:35.937 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:35 smithi062 bash[67442]: audit 2024-02-22T19:05:35.481198+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:05:35.937 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:35 smithi062 bash[67442]: audit 2024-02-22T19:05:35.481745+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:35.937 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:35 smithi062 bash[67442]: audit 2024-02-22T19:05:35.482460+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:35.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:35 smithi063 bash[35391]: cluster 2024-02-22T19:05:34.536574+0000 mon.a (mon.0) 240 : cluster [INF] osd.1 [v2:172.21.15.62:6810/1958140073,v1:172.21.15.62:6811/1958140073] boot 2024-02-22T19:05:35.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:35 smithi063 bash[35391]: cluster 2024-02-22T19:05:34.536620+0000 mon.a (mon.0) 241 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2024-02-22T19:05:35.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:35 smithi063 bash[35391]: audit 2024-02-22T19:05:34.537668+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:05:35.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:35 smithi063 bash[35391]: audit 2024-02-22T19:05:35.481198+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:05:35.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:35 smithi063 bash[35391]: audit 2024-02-22T19:05:35.481745+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:35.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:35 smithi063 bash[35391]: audit 2024-02-22T19:05:35.482460+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:36.807 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:36 smithi062 bash[67442]: cluster 2024-02-22T19:05:35.449098+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v69: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:36.807 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:36 smithi062 bash[67442]: audit 2024-02-22T19:05:35.480471+0000 mgr.y (mgr.14140) 77 : audit [DBG] from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:05:36.808 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:36 smithi062 bash[67442]: cephadm 2024-02-22T19:05:35.480993+0000 mgr.y (mgr.14140) 78 : cephadm [INF] Applying osd on host smithi062... 2024-02-22T19:05:36.808 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:36 smithi062 bash[67442]: cluster 2024-02-22T19:05:35.544381+0000 mon.a (mon.0) 246 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2024-02-22T19:05:36.808 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:36 smithi062 bash[67442]: audit 2024-02-22T19:05:35.545861+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240222-190325"}]: dispatch 2024-02-22T19:05:36.808 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:36 smithi062 bash[67442]: audit 2024-02-22T19:05:35.556826+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240222-190325"}]': finished 2024-02-22T19:05:36.808 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:36 smithi062 bash[64101]: cluster 2024-02-22T19:05:35.449098+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v69: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:36.808 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:36 smithi062 bash[64101]: audit 2024-02-22T19:05:35.480471+0000 mgr.y (mgr.14140) 77 : audit [DBG] from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:05:36.808 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:36 smithi062 bash[64101]: cephadm 2024-02-22T19:05:35.480993+0000 mgr.y (mgr.14140) 78 : cephadm [INF] Applying osd on host smithi062... 2024-02-22T19:05:36.808 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:36 smithi062 bash[64101]: cluster 2024-02-22T19:05:35.544381+0000 mon.a (mon.0) 246 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2024-02-22T19:05:36.808 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:36 smithi062 bash[64101]: audit 2024-02-22T19:05:35.545861+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240222-190325"}]: dispatch 2024-02-22T19:05:36.808 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:36 smithi062 bash[64101]: audit 2024-02-22T19:05:35.556826+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240222-190325"}]': finished 2024-02-22T19:05:36.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:36 smithi063 bash[35391]: cluster 2024-02-22T19:05:35.449098+0000 mgr.y (mgr.14140) 76 : cluster [DBG] pgmap v69: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-22T19:05:36.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:36 smithi063 bash[35391]: audit 2024-02-22T19:05:35.480471+0000 mgr.y (mgr.14140) 77 : audit [DBG] from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:05:36.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:36 smithi063 bash[35391]: cephadm 2024-02-22T19:05:35.480993+0000 mgr.y (mgr.14140) 78 : cephadm [INF] Applying osd on host smithi062... 2024-02-22T19:05:36.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:36 smithi063 bash[35391]: cluster 2024-02-22T19:05:35.544381+0000 mon.a (mon.0) 246 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2024-02-22T19:05:36.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:36 smithi063 bash[35391]: audit 2024-02-22T19:05:35.545861+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240222-190325"}]: dispatch 2024-02-22T19:05:36.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:36 smithi063 bash[35391]: audit 2024-02-22T19:05:35.556826+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240222-190325"}]': finished 2024-02-22T19:05:37.804 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:37 smithi062 bash[64101]: audit 2024-02-22T19:05:37.097715+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:05:37.805 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:37 smithi062 bash[67442]: audit 2024-02-22T19:05:37.097715+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:05:37.805 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:37 smithi062 bash[67442]: audit 2024-02-22T19:05:37.321989+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643834\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643909\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643943\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643973\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.644002\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}}, \"last_daemon_update\": \"2024-02-22T19:05:32.644073\", \"last_device_update\": \"2024-02-22T19:05:37.321348\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:37.806 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:37 smithi062 bash[64101]: audit 2024-02-22T19:05:37.321989+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643834\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643909\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643943\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643973\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.644002\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}}, \"last_daemon_update\": \"2024-02-22T19:05:32.644073\", \"last_device_update\": \"2024-02-22T19:05:37.321348\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:37.806 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:37 smithi062 bash[67442]: audit 2024-02-22T19:05:37.324605+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643834\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643909\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643943\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643973\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.644002\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}}, \"last_daemon_update\": \"2024-02-22T19:05:32.644073\", \"last_device_update\": \"2024-02-22T19:05:37.321348\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:37.806 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:37 smithi062 bash[67442]: cluster 2024-02-22T19:05:37.449389+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v71: 1 pgs: 1 undersized+peered; 0 B data, 288 KiB used, 177 GiB / 179 GiB avail 2024-02-22T19:05:37.806 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:37 smithi062 bash[64101]: audit 2024-02-22T19:05:37.324605+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643834\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643909\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643943\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643973\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.644002\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}}, \"last_daemon_update\": \"2024-02-22T19:05:32.644073\", \"last_device_update\": \"2024-02-22T19:05:37.321348\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:37.806 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:37 smithi062 bash[64101]: cluster 2024-02-22T19:05:37.449389+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v71: 1 pgs: 1 undersized+peered; 0 B data, 288 KiB used, 177 GiB / 179 GiB avail 2024-02-22T19:05:37.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:37 smithi063 bash[35391]: audit 2024-02-22T19:05:37.097715+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:05:37.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:37 smithi063 bash[35391]: audit 2024-02-22T19:05:37.321989+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643834\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643909\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643943\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643973\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.644002\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}}, \"last_daemon_update\": \"2024-02-22T19:05:32.644073\", \"last_device_update\": \"2024-02-22T19:05:37.321348\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:37.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:37 smithi063 bash[35391]: audit 2024-02-22T19:05:37.324605+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643834\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643909\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643943\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643973\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.644002\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}}, \"last_daemon_update\": \"2024-02-22T19:05:32.644073\", \"last_device_update\": \"2024-02-22T19:05:37.321348\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:37.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:37 smithi063 bash[35391]: cluster 2024-02-22T19:05:37.449389+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v71: 1 pgs: 1 undersized+peered; 0 B data, 288 KiB used, 177 GiB / 179 GiB avail 2024-02-22T19:05:39.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:39 smithi063 bash[35391]: audit 2024-02-22T19:05:38.507490+0000 mon.c (mon.1) 5 : audit [INF] from='client.? 172.21.15.62:0/4016815907' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d915b66-d47b-4dd0-a6c4-7144de928112"}]: dispatch 2024-02-22T19:05:39.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:39 smithi063 bash[35391]: audit 2024-02-22T19:05:38.507795+0000 mon.a (mon.0) 252 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d915b66-d47b-4dd0-a6c4-7144de928112"}]: dispatch 2024-02-22T19:05:39.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:39 smithi063 bash[35391]: audit 2024-02-22T19:05:38.511889+0000 mon.a (mon.0) 253 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d915b66-d47b-4dd0-a6c4-7144de928112"}]': finished 2024-02-22T19:05:39.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:39 smithi063 bash[35391]: cluster 2024-02-22T19:05:38.511925+0000 mon.a (mon.0) 254 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2024-02-22T19:05:39.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:39 smithi063 bash[35391]: audit 2024-02-22T19:05:38.512049+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:05:39.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:39 smithi063 bash[35391]: audit 2024-02-22T19:05:39.283661+0000 mon.a (mon.0) 256 : audit [DBG] from='client.? 172.21.15.62:0/3239858693' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:05:39.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:39 smithi062 bash[64101]: audit 2024-02-22T19:05:38.507490+0000 mon.c (mon.1) 5 : audit [INF] from='client.? 172.21.15.62:0/4016815907' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d915b66-d47b-4dd0-a6c4-7144de928112"}]: dispatch 2024-02-22T19:05:39.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:39 smithi062 bash[64101]: audit 2024-02-22T19:05:38.507795+0000 mon.a (mon.0) 252 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d915b66-d47b-4dd0-a6c4-7144de928112"}]: dispatch 2024-02-22T19:05:39.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:39 smithi062 bash[64101]: audit 2024-02-22T19:05:38.511889+0000 mon.a (mon.0) 253 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d915b66-d47b-4dd0-a6c4-7144de928112"}]': finished 2024-02-22T19:05:39.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:39 smithi062 bash[64101]: cluster 2024-02-22T19:05:38.511925+0000 mon.a (mon.0) 254 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2024-02-22T19:05:39.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:39 smithi062 bash[64101]: audit 2024-02-22T19:05:38.512049+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:05:39.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:39 smithi062 bash[64101]: audit 2024-02-22T19:05:39.283661+0000 mon.a (mon.0) 256 : audit [DBG] from='client.? 172.21.15.62:0/3239858693' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:05:39.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:39 smithi062 bash[67442]: audit 2024-02-22T19:05:38.507490+0000 mon.c (mon.1) 5 : audit [INF] from='client.? 172.21.15.62:0/4016815907' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d915b66-d47b-4dd0-a6c4-7144de928112"}]: dispatch 2024-02-22T19:05:39.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:39 smithi062 bash[67442]: audit 2024-02-22T19:05:38.507795+0000 mon.a (mon.0) 252 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5d915b66-d47b-4dd0-a6c4-7144de928112"}]: dispatch 2024-02-22T19:05:39.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:39 smithi062 bash[67442]: audit 2024-02-22T19:05:38.511889+0000 mon.a (mon.0) 253 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5d915b66-d47b-4dd0-a6c4-7144de928112"}]': finished 2024-02-22T19:05:39.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:39 smithi062 bash[67442]: cluster 2024-02-22T19:05:38.511925+0000 mon.a (mon.0) 254 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2024-02-22T19:05:39.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:39 smithi062 bash[67442]: audit 2024-02-22T19:05:38.512049+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:05:39.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:39 smithi062 bash[67442]: audit 2024-02-22T19:05:39.283661+0000 mon.a (mon.0) 256 : audit [DBG] from='client.? 172.21.15.62:0/3239858693' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:05:40.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:40 smithi063 bash[35391]: cluster 2024-02-22T19:05:39.449851+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v73: 1 pgs: 1 undersized+peered; 0 B data, 288 KiB used, 177 GiB / 179 GiB avail 2024-02-22T19:05:40.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:40 smithi062 bash[64101]: cluster 2024-02-22T19:05:39.449851+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v73: 1 pgs: 1 undersized+peered; 0 B data, 288 KiB used, 177 GiB / 179 GiB avail 2024-02-22T19:05:40.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:40 smithi062 bash[67442]: cluster 2024-02-22T19:05:39.449851+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v73: 1 pgs: 1 undersized+peered; 0 B data, 288 KiB used, 177 GiB / 179 GiB avail 2024-02-22T19:05:41.849 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:41 smithi062 bash[64101]: cluster 2024-02-22T19:05:41.450340+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:41.849 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:41 smithi062 bash[64101]: cluster 2024-02-22T19:05:41.501014+0000 mon.a (mon.0) 257 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-02-22T19:05:41.849 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:41 smithi062 bash[64101]: cluster 2024-02-22T19:05:41.501042+0000 mon.a (mon.0) 258 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-02-22T19:05:41.849 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:41 smithi062 bash[67442]: cluster 2024-02-22T19:05:41.450340+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:41.849 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:41 smithi062 bash[67442]: cluster 2024-02-22T19:05:41.501014+0000 mon.a (mon.0) 257 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-02-22T19:05:41.849 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:41 smithi062 bash[67442]: cluster 2024-02-22T19:05:41.501042+0000 mon.a (mon.0) 258 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-02-22T19:05:41.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:41 smithi063 bash[35391]: cluster 2024-02-22T19:05:41.450340+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:41.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:41 smithi063 bash[35391]: cluster 2024-02-22T19:05:41.501014+0000 mon.a (mon.0) 257 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-02-22T19:05:41.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:41 smithi063 bash[35391]: cluster 2024-02-22T19:05:41.501042+0000 mon.a (mon.0) 258 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-02-22T19:05:42.931 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:42 smithi062 bash[64101]: audit 2024-02-22T19:05:41.861402+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:42.931 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:42 smithi062 bash[67442]: audit 2024-02-22T19:05:41.861402+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:42.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:42 smithi063 bash[35391]: audit 2024-02-22T19:05:41.861402+0000 mon.a (mon.0) 259 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:43.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:43 smithi062 bash[64101]: cluster 2024-02-22T19:05:43.450832+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:43.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:43 smithi062 bash[67442]: cluster 2024-02-22T19:05:43.450832+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:43.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:43 smithi063 bash[35391]: cluster 2024-02-22T19:05:43.450832+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:44.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:44 smithi062 bash[64101]: audit 2024-02-22T19:05:44.463042+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-22T19:05:44.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:44 smithi062 bash[64101]: audit 2024-02-22T19:05:44.463708+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:44.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:44 smithi062 bash[64101]: cephadm 2024-02-22T19:05:44.464189+0000 mgr.y (mgr.14140) 83 : cephadm [INF] Deploying daemon osd.2 on smithi062 2024-02-22T19:05:44.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:44 smithi062 bash[64101]: audit 2024-02-22T19:05:44.464404+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2024-02-22T19:05:44.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:44 smithi062 bash[67442]: audit 2024-02-22T19:05:44.463042+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-22T19:05:44.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:44 smithi062 bash[67442]: audit 2024-02-22T19:05:44.463708+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:44.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:44 smithi062 bash[67442]: cephadm 2024-02-22T19:05:44.464189+0000 mgr.y (mgr.14140) 83 : cephadm [INF] Deploying daemon osd.2 on smithi062 2024-02-22T19:05:44.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:44 smithi062 bash[67442]: audit 2024-02-22T19:05:44.464404+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2024-02-22T19:05:44.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:44 smithi063 bash[35391]: audit 2024-02-22T19:05:44.463042+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-22T19:05:44.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:44 smithi063 bash[35391]: audit 2024-02-22T19:05:44.463708+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:44.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:44 smithi063 bash[35391]: cephadm 2024-02-22T19:05:44.464189+0000 mgr.y (mgr.14140) 83 : cephadm [INF] Deploying daemon osd.2 on smithi062 2024-02-22T19:05:44.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:44 smithi063 bash[35391]: audit 2024-02-22T19:05:44.464404+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2024-02-22T19:05:46.171 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 2 on host 'smithi062' 2024-02-22T19:05:46.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:46 smithi063 bash[35391]: cluster 2024-02-22T19:05:45.451181+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v76: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:46.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:46 smithi063 bash[35391]: audit 2024-02-22T19:05:46.163802+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643834\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643909\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643943\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643973\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.644002\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}}, \"last_device_update\": \"2024-02-22T19:05:37.321348\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:46.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:46 smithi063 bash[35391]: audit 2024-02-22T19:05:46.164533+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:05:46.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:46 smithi063 bash[35391]: audit 2024-02-22T19:05:46.167176+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643834\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643909\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643943\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643973\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.644002\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}}, \"last_device_update\": \"2024-02-22T19:05:37.321348\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:46.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:46 smithi062 bash[64101]: cluster 2024-02-22T19:05:45.451181+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v76: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:46.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:46 smithi062 bash[64101]: audit 2024-02-22T19:05:46.163802+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643834\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643909\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643943\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643973\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.644002\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}}, \"last_device_update\": \"2024-02-22T19:05:37.321348\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:46.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:46 smithi062 bash[64101]: audit 2024-02-22T19:05:46.164533+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:05:46.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:46 smithi062 bash[64101]: audit 2024-02-22T19:05:46.167176+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643834\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643909\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643943\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643973\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.644002\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}}, \"last_device_update\": \"2024-02-22T19:05:37.321348\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:46.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:46 smithi062 bash[67442]: cluster 2024-02-22T19:05:45.451181+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v76: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:46.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:46 smithi062 bash[67442]: audit 2024-02-22T19:05:46.163802+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643834\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643909\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643943\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643973\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.644002\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}}, \"last_device_update\": \"2024-02-22T19:05:37.321348\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:46.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:46 smithi062 bash[67442]: audit 2024-02-22T19:05:46.164533+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:05:46.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:46 smithi062 bash[67442]: audit 2024-02-22T19:05:46.167176+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643834\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643909\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643943\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.643973\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:32.644002\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}}, \"last_device_update\": \"2024-02-22T19:05:37.321348\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:47.393 DEBUG:teuthology.orchestra.run.smithi062:osd.2> sudo journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.2.service 2024-02-22T19:05:47.395 INFO:tasks.cephadm:Deploying osd.3 on smithi062 with /dev/vg_nvme/lv_1... 2024-02-22T19:05:47.396 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-22T19:05:47.427 INFO:journalctl@ceph.osd.2.smithi062.stdout:-- Logs begin at Thu 2024-02-22 18:41:31 UTC. -- 2024-02-22T19:05:48.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:48 smithi062 bash[64101]: cluster 2024-02-22T19:05:47.451494+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v77: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:48.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:48 smithi062 bash[67442]: cluster 2024-02-22T19:05:47.451494+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v77: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:48.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:48 smithi063 bash[35391]: cluster 2024-02-22T19:05:47.451494+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v77: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:49.319 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 22 19:05:49 smithi062 bash[72877]: debug 2024-02-22T19:05:49.212+0000 7fe8ae697ec0 -1 Falling back to public interface 2024-02-22T19:05:49.984 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 22 19:05:49 smithi062 bash[72877]: debug 2024-02-22T19:05:49.763+0000 7fe8ae697ec0 -1 osd.2 0 log_to_monitors {default=true} 2024-02-22T19:05:50.626 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-22T19:05:50.626 INFO:teuthology.orchestra.run.smithi062.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-22T19:05:50.626 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10+0 records in 2024-02-22T19:05:50.626 INFO:teuthology.orchestra.run.smithi062.stderr:10+0 records out 2024-02-22T19:05:50.626 INFO:teuthology.orchestra.run.smithi062.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124047 s, 845 MB/s 2024-02-22T19:05:50.626 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping successful for: 2024-02-22T19:05:50.829 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:50 smithi062 bash[64101]: cluster 2024-02-22T19:05:49.451894+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v78: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:50.829 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:50 smithi062 bash[64101]: audit 2024-02-22T19:05:49.767930+0000 mon.a (mon.0) 266 : audit [INF] from='osd.2 [v2:172.21.15.62:6818/3135175732,v1:172.21.15.62:6819/3135175732]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-22T19:05:50.830 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:50 smithi062 bash[64101]: audit 2024-02-22T19:05:50.370118+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369166\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369240\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369273\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369302\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369332\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369361\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}}, \"last_daemon_update\": \"2024-02-22T19:05:50.369432\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:50.830 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:50 smithi062 bash[64101]: audit 2024-02-22T19:05:50.372841+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369166\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369240\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369273\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369302\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369332\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369361\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}}, \"last_daemon_update\": \"2024-02-22T19:05:50.369432\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:50.830 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:50 smithi062 bash[64101]: audit 2024-02-22T19:05:50.373433+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:50.830 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:50 smithi062 bash[67442]: cluster 2024-02-22T19:05:49.451894+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v78: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:50.831 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:50 smithi062 bash[67442]: audit 2024-02-22T19:05:49.767930+0000 mon.a (mon.0) 266 : audit [INF] from='osd.2 [v2:172.21.15.62:6818/3135175732,v1:172.21.15.62:6819/3135175732]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-22T19:05:50.831 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:50 smithi062 bash[67442]: audit 2024-02-22T19:05:50.370118+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369166\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369240\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369273\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369302\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369332\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369361\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}}, \"last_daemon_update\": \"2024-02-22T19:05:50.369432\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:50.831 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:50 smithi062 bash[67442]: audit 2024-02-22T19:05:50.372841+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369166\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369240\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369273\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369302\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369332\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369361\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}}, \"last_daemon_update\": \"2024-02-22T19:05:50.369432\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:50.831 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:50 smithi062 bash[67442]: audit 2024-02-22T19:05:50.373433+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:50.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:50 smithi063 bash[35391]: cluster 2024-02-22T19:05:49.451894+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v78: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:50.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:50 smithi063 bash[35391]: audit 2024-02-22T19:05:49.767930+0000 mon.a (mon.0) 266 : audit [INF] from='osd.2 [v2:172.21.15.62:6818/3135175732,v1:172.21.15.62:6819/3135175732]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-22T19:05:50.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:50 smithi063 bash[35391]: audit 2024-02-22T19:05:50.370118+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369166\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369240\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369273\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369302\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369332\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369361\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}}, \"last_daemon_update\": \"2024-02-22T19:05:50.369432\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:50.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:50 smithi063 bash[35391]: audit 2024-02-22T19:05:50.372841+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369166\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369240\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369273\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369302\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369332\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369361\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}}, \"last_daemon_update\": \"2024-02-22T19:05:50.369432\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:50.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:50 smithi063 bash[35391]: audit 2024-02-22T19:05:50.373433+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:51.925 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:51 smithi062 bash[64101]: audit 2024-02-22T19:05:50.510096+0000 mon.a (mon.0) 270 : audit [INF] from='osd.2 [v2:172.21.15.62:6818/3135175732,v1:172.21.15.62:6819/3135175732]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-22T19:05:51.926 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:51 smithi062 bash[64101]: cluster 2024-02-22T19:05:50.510145+0000 mon.a (mon.0) 271 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2024-02-22T19:05:51.926 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:51 smithi062 bash[64101]: audit 2024-02-22T19:05:50.510691+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:05:51.926 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:51 smithi062 bash[64101]: audit 2024-02-22T19:05:50.511055+0000 mon.a (mon.0) 273 : audit [INF] from='osd.2 [v2:172.21.15.62:6818/3135175732,v1:172.21.15.62:6819/3135175732]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-22T19:05:51.926 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:51 smithi062 bash[67442]: audit 2024-02-22T19:05:50.510096+0000 mon.a (mon.0) 270 : audit [INF] from='osd.2 [v2:172.21.15.62:6818/3135175732,v1:172.21.15.62:6819/3135175732]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-22T19:05:51.926 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:51 smithi062 bash[67442]: cluster 2024-02-22T19:05:50.510145+0000 mon.a (mon.0) 271 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2024-02-22T19:05:51.926 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:51 smithi062 bash[67442]: audit 2024-02-22T19:05:50.510691+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:05:51.926 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:51 smithi062 bash[67442]: audit 2024-02-22T19:05:50.511055+0000 mon.a (mon.0) 273 : audit [INF] from='osd.2 [v2:172.21.15.62:6818/3135175732,v1:172.21.15.62:6819/3135175732]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-22T19:05:51.926 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 22 19:05:51 smithi062 bash[72877]: debug 2024-02-22T19:05:51.513+0000 7fe89744c700 -1 osd.2 0 waiting for initial osdmap 2024-02-22T19:05:51.926 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 22 19:05:51 smithi062 bash[72877]: debug 2024-02-22T19:05:51.520+0000 7fe8a2668700 -1 osd.2 20 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-22T19:05:51.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:51 smithi063 bash[35391]: audit 2024-02-22T19:05:50.510096+0000 mon.a (mon.0) 270 : audit [INF] from='osd.2 [v2:172.21.15.62:6818/3135175732,v1:172.21.15.62:6819/3135175732]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-22T19:05:51.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:51 smithi063 bash[35391]: cluster 2024-02-22T19:05:50.510145+0000 mon.a (mon.0) 271 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2024-02-22T19:05:51.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:51 smithi063 bash[35391]: audit 2024-02-22T19:05:50.510691+0000 mon.a (mon.0) 272 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:05:51.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:51 smithi063 bash[35391]: audit 2024-02-22T19:05:50.511055+0000 mon.a (mon.0) 273 : audit [INF] from='osd.2 [v2:172.21.15.62:6818/3135175732,v1:172.21.15.62:6819/3135175732]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-22T19:05:52.484 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph orch daemon add osd smithi062:vg_nvme/lv_1 2024-02-22T19:05:52.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:52 smithi062 bash[67442]: cluster 2024-02-22T19:05:50.773873+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:05:52.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:52 smithi062 bash[67442]: cluster 2024-02-22T19:05:50.773950+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:05:52.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:52 smithi062 bash[67442]: cluster 2024-02-22T19:05:51.452290+0000 mgr.y (mgr.14140) 87 : cluster [DBG] pgmap v80: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:52.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:52 smithi062 bash[67442]: audit 2024-02-22T19:05:51.511948+0000 mon.a (mon.0) 274 : audit [INF] from='osd.2 [v2:172.21.15.62:6818/3135175732,v1:172.21.15.62:6819/3135175732]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-22T19:05:52.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:52 smithi062 bash[67442]: cluster 2024-02-22T19:05:51.511990+0000 mon.a (mon.0) 275 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2024-02-22T19:05:52.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:52 smithi062 bash[67442]: audit 2024-02-22T19:05:51.512124+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:05:52.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:52 smithi062 bash[64101]: cluster 2024-02-22T19:05:50.773873+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:05:52.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:52 smithi062 bash[64101]: cluster 2024-02-22T19:05:50.773950+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:05:52.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:52 smithi062 bash[64101]: cluster 2024-02-22T19:05:51.452290+0000 mgr.y (mgr.14140) 87 : cluster [DBG] pgmap v80: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:52.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:52 smithi062 bash[64101]: audit 2024-02-22T19:05:51.511948+0000 mon.a (mon.0) 274 : audit [INF] from='osd.2 [v2:172.21.15.62:6818/3135175732,v1:172.21.15.62:6819/3135175732]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-22T19:05:52.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:52 smithi062 bash[64101]: cluster 2024-02-22T19:05:51.511990+0000 mon.a (mon.0) 275 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2024-02-22T19:05:52.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:52 smithi062 bash[64101]: audit 2024-02-22T19:05:51.512124+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:05:52.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:52 smithi063 bash[35391]: cluster 2024-02-22T19:05:50.773873+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:05:52.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:52 smithi063 bash[35391]: cluster 2024-02-22T19:05:50.773950+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:05:52.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:52 smithi063 bash[35391]: cluster 2024-02-22T19:05:51.452290+0000 mgr.y (mgr.14140) 87 : cluster [DBG] pgmap v80: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:52.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:52 smithi063 bash[35391]: audit 2024-02-22T19:05:51.511948+0000 mon.a (mon.0) 274 : audit [INF] from='osd.2 [v2:172.21.15.62:6818/3135175732,v1:172.21.15.62:6819/3135175732]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-22T19:05:52.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:52 smithi063 bash[35391]: cluster 2024-02-22T19:05:51.511990+0000 mon.a (mon.0) 275 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2024-02-22T19:05:52.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:52 smithi063 bash[35391]: audit 2024-02-22T19:05:51.512124+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:05:53.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:53 smithi063 bash[35391]: cluster 2024-02-22T19:05:52.527507+0000 mon.a (mon.0) 277 : cluster [INF] osd.2 [v2:172.21.15.62:6818/3135175732,v1:172.21.15.62:6819/3135175732] boot 2024-02-22T19:05:53.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:53 smithi063 bash[35391]: cluster 2024-02-22T19:05:52.527551+0000 mon.a (mon.0) 278 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-22T19:05:53.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:53 smithi063 bash[35391]: audit 2024-02-22T19:05:52.528232+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:05:53.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:53 smithi063 bash[35391]: cluster 2024-02-22T19:05:53.522653+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-02-22T19:05:53.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:53 smithi062 bash[64101]: cluster 2024-02-22T19:05:52.527507+0000 mon.a (mon.0) 277 : cluster [INF] osd.2 [v2:172.21.15.62:6818/3135175732,v1:172.21.15.62:6819/3135175732] boot 2024-02-22T19:05:53.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:53 smithi062 bash[64101]: cluster 2024-02-22T19:05:52.527551+0000 mon.a (mon.0) 278 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-22T19:05:53.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:53 smithi062 bash[64101]: audit 2024-02-22T19:05:52.528232+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:05:53.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:53 smithi062 bash[64101]: cluster 2024-02-22T19:05:53.522653+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-02-22T19:05:53.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:53 smithi062 bash[67442]: cluster 2024-02-22T19:05:52.527507+0000 mon.a (mon.0) 277 : cluster [INF] osd.2 [v2:172.21.15.62:6818/3135175732,v1:172.21.15.62:6819/3135175732] boot 2024-02-22T19:05:53.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:53 smithi062 bash[67442]: cluster 2024-02-22T19:05:52.527551+0000 mon.a (mon.0) 278 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-22T19:05:53.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:53 smithi062 bash[67442]: audit 2024-02-22T19:05:52.528232+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:05:53.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:53 smithi062 bash[67442]: cluster 2024-02-22T19:05:53.522653+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-02-22T19:05:54.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:54 smithi063 bash[35391]: cluster 2024-02-22T19:05:53.452548+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v83: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:54.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:54 smithi062 bash[64101]: cluster 2024-02-22T19:05:53.452548+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v83: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:54.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:54 smithi062 bash[67442]: cluster 2024-02-22T19:05:53.452548+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v83: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:55.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:55 smithi062 bash[64101]: audit 2024-02-22T19:05:55.034296+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:05:55.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:55 smithi062 bash[64101]: audit 2024-02-22T19:05:55.034851+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:55.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:55 smithi062 bash[64101]: audit 2024-02-22T19:05:55.035657+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:55.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:55 smithi062 bash[64101]: audit 2024-02-22T19:05:55.134154+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:05:55.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:55 smithi062 bash[67442]: audit 2024-02-22T19:05:55.034296+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:05:55.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:55 smithi062 bash[67442]: audit 2024-02-22T19:05:55.034851+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:55.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:55 smithi062 bash[67442]: audit 2024-02-22T19:05:55.035657+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:55.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:55 smithi062 bash[67442]: audit 2024-02-22T19:05:55.134154+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:05:55.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:55 smithi062 bash[64101]: audit 2024-02-22T19:05:55.348611+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369166\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369240\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369273\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369302\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369332\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369361\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}}, \"last_daemon_update\": \"2024-02-22T19:05:50.369432\", \"last_device_update\": \"2024-02-22T19:05:55.347897\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:55.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:55 smithi062 bash[64101]: audit 2024-02-22T19:05:55.351447+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369166\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369240\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369273\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369302\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369332\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369361\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}}, \"last_daemon_update\": \"2024-02-22T19:05:50.369432\", \"last_device_update\": \"2024-02-22T19:05:55.347897\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:55.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:55 smithi062 bash[67442]: audit 2024-02-22T19:05:55.348611+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369166\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369240\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369273\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369302\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369332\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369361\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}}, \"last_daemon_update\": \"2024-02-22T19:05:50.369432\", \"last_device_update\": \"2024-02-22T19:05:55.347897\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:55.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:55 smithi062 bash[67442]: audit 2024-02-22T19:05:55.351447+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369166\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369240\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369273\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369302\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369332\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369361\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}}, \"last_daemon_update\": \"2024-02-22T19:05:50.369432\", \"last_device_update\": \"2024-02-22T19:05:55.347897\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:55.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:55 smithi063 bash[35391]: audit 2024-02-22T19:05:55.034296+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:05:55.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:55 smithi063 bash[35391]: audit 2024-02-22T19:05:55.034851+0000 mon.a (mon.0) 282 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:05:55.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:55 smithi063 bash[35391]: audit 2024-02-22T19:05:55.035657+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:05:55.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:55 smithi063 bash[35391]: audit 2024-02-22T19:05:55.134154+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:05:55.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:55 smithi063 bash[35391]: audit 2024-02-22T19:05:55.348611+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369166\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369240\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369273\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369302\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369332\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369361\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}}, \"last_daemon_update\": \"2024-02-22T19:05:50.369432\", \"last_device_update\": \"2024-02-22T19:05:55.347897\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:05:55.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:55 smithi063 bash[35391]: audit 2024-02-22T19:05:55.351447+0000 mon.a (mon.0) 286 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369166\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369240\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369273\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369302\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369332\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369361\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}}, \"last_daemon_update\": \"2024-02-22T19:05:50.369432\", \"last_device_update\": \"2024-02-22T19:05:55.347897\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:05:56.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:56 smithi063 bash[35391]: audit 2024-02-22T19:05:55.033455+0000 mgr.y (mgr.14140) 89 : audit [DBG] from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:05:56.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:56 smithi063 bash[35391]: cephadm 2024-02-22T19:05:55.034029+0000 mgr.y (mgr.14140) 90 : cephadm [INF] Applying osd on host smithi062... 2024-02-22T19:05:56.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:56 smithi063 bash[35391]: cluster 2024-02-22T19:05:55.452891+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v85: 1 pgs: 1 active+undersized+degraded; 0 B data, 504 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:56.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:56 smithi062 bash[64101]: audit 2024-02-22T19:05:55.033455+0000 mgr.y (mgr.14140) 89 : audit [DBG] from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:05:56.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:56 smithi062 bash[64101]: cephadm 2024-02-22T19:05:55.034029+0000 mgr.y (mgr.14140) 90 : cephadm [INF] Applying osd on host smithi062... 2024-02-22T19:05:56.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:56 smithi062 bash[64101]: cluster 2024-02-22T19:05:55.452891+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v85: 1 pgs: 1 active+undersized+degraded; 0 B data, 504 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:56.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:56 smithi062 bash[67442]: audit 2024-02-22T19:05:55.033455+0000 mgr.y (mgr.14140) 89 : audit [DBG] from='client.14283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:05:56.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:56 smithi062 bash[67442]: cephadm 2024-02-22T19:05:55.034029+0000 mgr.y (mgr.14140) 90 : cephadm [INF] Applying osd on host smithi062... 2024-02-22T19:05:56.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:56 smithi062 bash[67442]: cluster 2024-02-22T19:05:55.452891+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v85: 1 pgs: 1 active+undersized+degraded; 0 B data, 504 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2024-02-22T19:05:57.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:57 smithi063 bash[35391]: audit 2024-02-22T19:05:57.196812+0000 mon.a (mon.0) 287 : audit [INF] from='client.? 172.21.15.62:0/182969243' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed642f1e-2a27-46e6-a7e2-dba0a3ccb432"}]: dispatch 2024-02-22T19:05:57.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:57 smithi063 bash[35391]: audit 2024-02-22T19:05:57.200091+0000 mon.a (mon.0) 288 : audit [INF] from='client.? 172.21.15.62:0/182969243' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ed642f1e-2a27-46e6-a7e2-dba0a3ccb432"}]': finished 2024-02-22T19:05:57.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:57 smithi063 bash[35391]: cluster 2024-02-22T19:05:57.200119+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2024-02-22T19:05:57.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:57 smithi063 bash[35391]: audit 2024-02-22T19:05:57.200206+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:05:57.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:57 smithi062 bash[64101]: audit 2024-02-22T19:05:57.196812+0000 mon.a (mon.0) 287 : audit [INF] from='client.? 172.21.15.62:0/182969243' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed642f1e-2a27-46e6-a7e2-dba0a3ccb432"}]: dispatch 2024-02-22T19:05:57.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:57 smithi062 bash[64101]: audit 2024-02-22T19:05:57.200091+0000 mon.a (mon.0) 288 : audit [INF] from='client.? 172.21.15.62:0/182969243' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ed642f1e-2a27-46e6-a7e2-dba0a3ccb432"}]': finished 2024-02-22T19:05:57.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:57 smithi062 bash[64101]: cluster 2024-02-22T19:05:57.200119+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2024-02-22T19:05:57.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:57 smithi062 bash[64101]: audit 2024-02-22T19:05:57.200206+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:05:57.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:57 smithi062 bash[67442]: audit 2024-02-22T19:05:57.196812+0000 mon.a (mon.0) 287 : audit [INF] from='client.? 172.21.15.62:0/182969243' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed642f1e-2a27-46e6-a7e2-dba0a3ccb432"}]: dispatch 2024-02-22T19:05:57.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:57 smithi062 bash[67442]: audit 2024-02-22T19:05:57.200091+0000 mon.a (mon.0) 288 : audit [INF] from='client.? 172.21.15.62:0/182969243' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ed642f1e-2a27-46e6-a7e2-dba0a3ccb432"}]': finished 2024-02-22T19:05:57.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:57 smithi062 bash[67442]: cluster 2024-02-22T19:05:57.200119+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2024-02-22T19:05:57.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:57 smithi062 bash[67442]: audit 2024-02-22T19:05:57.200206+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:05:58.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:58 smithi063 bash[35391]: cluster 2024-02-22T19:05:57.453171+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 568 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:05:58.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:58 smithi063 bash[35391]: audit 2024-02-22T19:05:57.940307+0000 mon.a (mon.0) 291 : audit [DBG] from='client.? 172.21.15.62:0/3920382338' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:05:58.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:58 smithi063 bash[35391]: cluster 2024-02-22T19:05:58.198372+0000 mon.a (mon.0) 292 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2024-02-22T19:05:58.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:05:58 smithi063 bash[35391]: cluster 2024-02-22T19:05:58.198400+0000 mon.a (mon.0) 293 : cluster [INF] Cluster is now healthy 2024-02-22T19:05:58.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:58 smithi062 bash[64101]: cluster 2024-02-22T19:05:57.453171+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 568 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:05:58.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:58 smithi062 bash[64101]: audit 2024-02-22T19:05:57.940307+0000 mon.a (mon.0) 291 : audit [DBG] from='client.? 172.21.15.62:0/3920382338' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:05:58.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:58 smithi062 bash[64101]: cluster 2024-02-22T19:05:58.198372+0000 mon.a (mon.0) 292 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2024-02-22T19:05:58.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:05:58 smithi062 bash[64101]: cluster 2024-02-22T19:05:58.198400+0000 mon.a (mon.0) 293 : cluster [INF] Cluster is now healthy 2024-02-22T19:05:58.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:58 smithi062 bash[67442]: cluster 2024-02-22T19:05:57.453171+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 568 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:05:58.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:58 smithi062 bash[67442]: audit 2024-02-22T19:05:57.940307+0000 mon.a (mon.0) 291 : audit [DBG] from='client.? 172.21.15.62:0/3920382338' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:05:58.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:58 smithi062 bash[67442]: cluster 2024-02-22T19:05:58.198372+0000 mon.a (mon.0) 292 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2024-02-22T19:05:58.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:05:58 smithi062 bash[67442]: cluster 2024-02-22T19:05:58.198400+0000 mon.a (mon.0) 293 : cluster [INF] Cluster is now healthy 2024-02-22T19:06:00.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:00 smithi062 bash[64101]: cluster 2024-02-22T19:05:59.453527+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 584 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:00.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:00 smithi062 bash[64101]: audit 2024-02-22T19:06:00.485540+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:00.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:00 smithi062 bash[67442]: cluster 2024-02-22T19:05:59.453527+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 584 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:00.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:00 smithi062 bash[67442]: audit 2024-02-22T19:06:00.485540+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:00.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:00 smithi063 bash[35391]: cluster 2024-02-22T19:05:59.453527+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 584 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:00.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:00 smithi063 bash[35391]: audit 2024-02-22T19:06:00.485540+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:01.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:01 smithi062 bash[64101]: cluster 2024-02-22T19:06:01.453918+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:01.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:01 smithi062 bash[67442]: cluster 2024-02-22T19:06:01.453918+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:01.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:01 smithi063 bash[35391]: cluster 2024-02-22T19:06:01.453918+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:03.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:03 smithi063 bash[35391]: audit 2024-02-22T19:06:03.146667+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-22T19:06:03.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:03 smithi063 bash[35391]: audit 2024-02-22T19:06:03.147318+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:03.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:03 smithi063 bash[35391]: audit 2024-02-22T19:06:03.148015+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2024-02-22T19:06:03.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:03 smithi062 bash[64101]: audit 2024-02-22T19:06:03.146667+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-22T19:06:03.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:03 smithi062 bash[64101]: audit 2024-02-22T19:06:03.147318+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:03.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:03 smithi062 bash[64101]: audit 2024-02-22T19:06:03.148015+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2024-02-22T19:06:03.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:03 smithi062 bash[67442]: audit 2024-02-22T19:06:03.146667+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-22T19:06:03.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:03 smithi062 bash[67442]: audit 2024-02-22T19:06:03.147318+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:03.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:03 smithi062 bash[67442]: audit 2024-02-22T19:06:03.148015+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2024-02-22T19:06:04.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:04 smithi063 bash[35391]: cephadm 2024-02-22T19:06:03.147794+0000 mgr.y (mgr.14140) 95 : cephadm [INF] Deploying daemon osd.3 on smithi062 2024-02-22T19:06:04.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:04 smithi063 bash[35391]: cluster 2024-02-22T19:06:03.454206+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:04.473 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:04 smithi062 bash[64101]: cephadm 2024-02-22T19:06:03.147794+0000 mgr.y (mgr.14140) 95 : cephadm [INF] Deploying daemon osd.3 on smithi062 2024-02-22T19:06:04.473 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:04 smithi062 bash[64101]: cluster 2024-02-22T19:06:03.454206+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:04.473 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:04 smithi062 bash[67442]: cephadm 2024-02-22T19:06:03.147794+0000 mgr.y (mgr.14140) 95 : cephadm [INF] Deploying daemon osd.3 on smithi062 2024-02-22T19:06:04.473 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:04 smithi062 bash[67442]: cluster 2024-02-22T19:06:03.454206+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:04.824 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 3 on host 'smithi062' 2024-02-22T19:06:05.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:05 smithi063 bash[35391]: audit 2024-02-22T19:06:04.817014+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369166\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369240\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369273\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369302\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369332\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369361\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}}, \"last_device_update\": \"2024-02-22T19:05:55.347897\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:06:05.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:05 smithi063 bash[35391]: audit 2024-02-22T19:06:04.817470+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:06:05.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:05 smithi063 bash[35391]: audit 2024-02-22T19:06:04.820284+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369166\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369240\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369273\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369302\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369332\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369361\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}}, \"last_device_update\": \"2024-02-22T19:05:55.347897\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:06:05.474 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:05 smithi062 bash[64101]: audit 2024-02-22T19:06:04.817014+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369166\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369240\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369273\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369302\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369332\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369361\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}}, \"last_device_update\": \"2024-02-22T19:05:55.347897\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:06:05.474 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:05 smithi062 bash[64101]: audit 2024-02-22T19:06:04.817470+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:06:05.474 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:05 smithi062 bash[64101]: audit 2024-02-22T19:06:04.820284+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369166\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369240\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369273\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369302\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369332\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369361\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}}, \"last_device_update\": \"2024-02-22T19:05:55.347897\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:06:05.474 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:05 smithi062 bash[67442]: audit 2024-02-22T19:06:04.817014+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369166\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369240\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369273\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369302\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369332\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369361\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}}, \"last_device_update\": \"2024-02-22T19:05:55.347897\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:06:05.474 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:05 smithi062 bash[67442]: audit 2024-02-22T19:06:04.817470+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:06:05.474 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:05 smithi062 bash[67442]: audit 2024-02-22T19:06:04.820284+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369166\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369240\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369273\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369302\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369332\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:05:50.369361\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}}, \"last_device_update\": \"2024-02-22T19:05:55.347897\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:06:05.732 DEBUG:teuthology.orchestra.run.smithi062:osd.3> sudo journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.3.service 2024-02-22T19:06:05.734 INFO:tasks.cephadm:Deploying osd.4 on smithi063 with /dev/vg_nvme/lv_4... 2024-02-22T19:06:05.735 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-22T19:06:05.767 INFO:journalctl@ceph.osd.3.smithi062.stdout:-- Logs begin at Thu 2024-02-22 18:41:31 UTC. -- 2024-02-22T19:06:06.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:06 smithi063 bash[35391]: cluster 2024-02-22T19:06:05.454596+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:06.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:06 smithi062 bash[64101]: cluster 2024-02-22T19:06:05.454596+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:06.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:06 smithi062 bash[67442]: cluster 2024-02-22T19:06:05.454596+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:06.735 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 22 19:06:06 smithi062 bash[74223]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-22T19:06:06.735 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 22 19:06:06 smithi062 bash[74223]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-02-22T19:06:06.735 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 22 19:06:06 smithi062 bash[74223]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2024-02-22T19:06:06.735 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 22 19:06:06 smithi062 bash[74223]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-02-22T19:06:06.735 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 22 19:06:06 smithi062 bash[74223]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-02-22T19:06:06.735 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 22 19:06:06 smithi062 bash[74223]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-22T19:06:06.735 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 22 19:06:06 smithi062 bash[74223]: --> ceph-volume lvm activate successful for osd ID: 3 2024-02-22T19:06:08.117 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-22T19:06:08.118 INFO:teuthology.orchestra.run.smithi063.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-22T19:06:08.118 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10+0 records in 2024-02-22T19:06:08.118 INFO:teuthology.orchestra.run.smithi063.stderr:10+0 records out 2024-02-22T19:06:08.118 INFO:teuthology.orchestra.run.smithi063.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0109472 s, 958 MB/s 2024-02-22T19:06:08.118 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping successful for: 2024-02-22T19:06:08.235 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 22 19:06:07 smithi062 bash[74469]: debug 2024-02-22T19:06:07.919+0000 7f0beff89ec0 -1 Falling back to public interface 2024-02-22T19:06:08.734 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 22 19:06:08 smithi062 bash[74469]: debug 2024-02-22T19:06:08.488+0000 7f0beff89ec0 -1 osd.3 0 log_to_monitors {default=true} 2024-02-22T19:06:08.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:08 smithi062 bash[67442]: cluster 2024-02-22T19:06:07.454874+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T19:06:08.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:08 smithi062 bash[64101]: cluster 2024-02-22T19:06:07.454874+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T19:06:08.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:08 smithi062 bash[67442]: audit 2024-02-22T19:06:07.656536+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}}, \"last_daemon_update\": \"2024-02-22T19:06:07.655844\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:06:08.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:08 smithi062 bash[64101]: audit 2024-02-22T19:06:07.656536+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}}, \"last_daemon_update\": \"2024-02-22T19:06:07.655844\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:06:08.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:08 smithi062 bash[67442]: audit 2024-02-22T19:06:07.659964+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}}, \"last_daemon_update\": \"2024-02-22T19:06:07.655844\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:06:08.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:08 smithi062 bash[67442]: audit 2024-02-22T19:06:07.660476+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:08.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:08 smithi062 bash[67442]: audit 2024-02-22T19:06:08.492429+0000 mon.c (mon.1) 6 : audit [INF] from='osd.3 [v2:172.21.15.62:6826/1626592673,v1:172.21.15.62:6827/1626592673]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-22T19:06:08.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:08 smithi062 bash[67442]: audit 2024-02-22T19:06:08.492763+0000 mon.a (mon.0) 304 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-22T19:06:08.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:08 smithi062 bash[64101]: audit 2024-02-22T19:06:07.659964+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}}, \"last_daemon_update\": \"2024-02-22T19:06:07.655844\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:06:08.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:08 smithi062 bash[64101]: audit 2024-02-22T19:06:07.660476+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:08.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:08 smithi062 bash[64101]: audit 2024-02-22T19:06:08.492429+0000 mon.c (mon.1) 6 : audit [INF] from='osd.3 [v2:172.21.15.62:6826/1626592673,v1:172.21.15.62:6827/1626592673]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-22T19:06:08.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:08 smithi062 bash[64101]: audit 2024-02-22T19:06:08.492763+0000 mon.a (mon.0) 304 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-22T19:06:08.838 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:08 smithi063 bash[35391]: cluster 2024-02-22T19:06:07.454874+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T19:06:08.838 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:08 smithi063 bash[35391]: audit 2024-02-22T19:06:07.656536+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}}, \"last_daemon_update\": \"2024-02-22T19:06:07.655844\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:06:08.839 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:08 smithi063 bash[35391]: audit 2024-02-22T19:06:07.659964+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}}, \"last_daemon_update\": \"2024-02-22T19:06:07.655844\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:06:08.839 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:08 smithi063 bash[35391]: audit 2024-02-22T19:06:07.660476+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:08.839 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:08 smithi063 bash[35391]: audit 2024-02-22T19:06:08.492429+0000 mon.c (mon.1) 6 : audit [INF] from='osd.3 [v2:172.21.15.62:6826/1626592673,v1:172.21.15.62:6827/1626592673]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-22T19:06:08.839 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:08 smithi063 bash[35391]: audit 2024-02-22T19:06:08.492763+0000 mon.a (mon.0) 304 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-22T19:06:08.848 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph orch daemon add osd smithi063:vg_nvme/lv_4 2024-02-22T19:06:09.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:09 smithi063 bash[35391]: audit 2024-02-22T19:06:08.663578+0000 mon.a (mon.0) 305 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-22T19:06:09.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:09 smithi063 bash[35391]: cluster 2024-02-22T19:06:08.663611+0000 mon.a (mon.0) 306 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2024-02-22T19:06:09.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:09 smithi063 bash[35391]: audit 2024-02-22T19:06:08.663758+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:06:09.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:09 smithi063 bash[35391]: audit 2024-02-22T19:06:08.664061+0000 mon.c (mon.1) 7 : audit [INF] from='osd.3 [v2:172.21.15.62:6826/1626592673,v1:172.21.15.62:6827/1626592673]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-22T19:06:09.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:09 smithi063 bash[35391]: audit 2024-02-22T19:06:08.664340+0000 mon.a (mon.0) 308 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-22T19:06:09.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:09 smithi063 bash[35391]: cluster 2024-02-22T19:06:09.444425+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:06:09.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:09 smithi063 bash[35391]: cluster 2024-02-22T19:06:09.444465+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:06:09.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:09 smithi063 bash[35391]: cluster 2024-02-22T19:06:09.455163+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T19:06:09.985 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 22 19:06:09 smithi062 bash[74469]: debug 2024-02-22T19:06:09.668+0000 7f0bd4d36700 -1 osd.3 0 waiting for initial osdmap 2024-02-22T19:06:09.985 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 22 19:06:09 smithi062 bash[74469]: debug 2024-02-22T19:06:09.673+0000 7f0bdff52700 -1 osd.3 25 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-22T19:06:09.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:09 smithi062 bash[64101]: audit 2024-02-22T19:06:08.663578+0000 mon.a (mon.0) 305 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-22T19:06:09.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:09 smithi062 bash[64101]: cluster 2024-02-22T19:06:08.663611+0000 mon.a (mon.0) 306 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2024-02-22T19:06:09.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:09 smithi062 bash[64101]: audit 2024-02-22T19:06:08.663758+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:06:09.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:09 smithi062 bash[64101]: audit 2024-02-22T19:06:08.664061+0000 mon.c (mon.1) 7 : audit [INF] from='osd.3 [v2:172.21.15.62:6826/1626592673,v1:172.21.15.62:6827/1626592673]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-22T19:06:09.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:09 smithi062 bash[64101]: audit 2024-02-22T19:06:08.664340+0000 mon.a (mon.0) 308 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-22T19:06:09.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:09 smithi062 bash[64101]: cluster 2024-02-22T19:06:09.444425+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:06:09.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:09 smithi062 bash[64101]: cluster 2024-02-22T19:06:09.444465+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:06:09.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:09 smithi062 bash[64101]: cluster 2024-02-22T19:06:09.455163+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T19:06:09.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:09 smithi062 bash[67442]: audit 2024-02-22T19:06:08.663578+0000 mon.a (mon.0) 305 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-22T19:06:09.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:09 smithi062 bash[67442]: cluster 2024-02-22T19:06:08.663611+0000 mon.a (mon.0) 306 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2024-02-22T19:06:09.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:09 smithi062 bash[67442]: audit 2024-02-22T19:06:08.663758+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:06:09.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:09 smithi062 bash[67442]: audit 2024-02-22T19:06:08.664061+0000 mon.c (mon.1) 7 : audit [INF] from='osd.3 [v2:172.21.15.62:6826/1626592673,v1:172.21.15.62:6827/1626592673]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-22T19:06:09.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:09 smithi062 bash[67442]: audit 2024-02-22T19:06:08.664340+0000 mon.a (mon.0) 308 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-22T19:06:09.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:09 smithi062 bash[67442]: cluster 2024-02-22T19:06:09.444425+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:06:09.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:09 smithi062 bash[67442]: cluster 2024-02-22T19:06:09.444465+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:06:09.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:09 smithi062 bash[67442]: cluster 2024-02-22T19:06:09.455163+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-22T19:06:10.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:10 smithi063 bash[35391]: audit 2024-02-22T19:06:09.667390+0000 mon.a (mon.0) 309 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-22T19:06:10.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:10 smithi063 bash[35391]: cluster 2024-02-22T19:06:09.667443+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2024-02-22T19:06:10.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:10 smithi063 bash[35391]: audit 2024-02-22T19:06:09.668748+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:06:10.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:10 smithi062 bash[67442]: audit 2024-02-22T19:06:09.667390+0000 mon.a (mon.0) 309 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-22T19:06:10.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:10 smithi062 bash[67442]: cluster 2024-02-22T19:06:09.667443+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2024-02-22T19:06:10.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:10 smithi062 bash[67442]: audit 2024-02-22T19:06:09.668748+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:06:10.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:10 smithi062 bash[64101]: audit 2024-02-22T19:06:09.667390+0000 mon.a (mon.0) 309 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-22T19:06:10.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:10 smithi062 bash[64101]: cluster 2024-02-22T19:06:09.667443+0000 mon.a (mon.0) 310 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2024-02-22T19:06:10.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:10 smithi062 bash[64101]: audit 2024-02-22T19:06:09.668748+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:06:11.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:11 smithi063 bash[35391]: cluster 2024-02-22T19:06:10.667691+0000 mon.a (mon.0) 312 : cluster [INF] osd.3 [v2:172.21.15.62:6826/1626592673,v1:172.21.15.62:6827/1626592673] boot 2024-02-22T19:06:11.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:11 smithi063 bash[35391]: cluster 2024-02-22T19:06:10.667721+0000 mon.a (mon.0) 313 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-22T19:06:11.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:11 smithi063 bash[35391]: audit 2024-02-22T19:06:10.668140+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:06:11.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:11 smithi063 bash[35391]: audit 2024-02-22T19:06:10.719885+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:06:11.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:11 smithi063 bash[35391]: audit 2024-02-22T19:06:10.873964+0000 mgr.y (mgr.14140) 100 : audit [DBG] from='client.34181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:11.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:11 smithi063 bash[35391]: cephadm 2024-02-22T19:06:10.874746+0000 mgr.y (mgr.14140) 101 : cephadm [INF] Applying osd on host smithi063... 2024-02-22T19:06:11.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:11 smithi063 bash[35391]: audit 2024-02-22T19:06:10.875025+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:06:11.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:11 smithi063 bash[35391]: audit 2024-02-22T19:06:10.875627+0000 mon.a (mon.0) 317 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:11.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:11 smithi063 bash[35391]: audit 2024-02-22T19:06:10.876454+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:11.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:11 smithi063 bash[35391]: audit 2024-02-22T19:06:10.932778+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}}, \"last_daemon_update\": \"2024-02-22T19:06:07.655844\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:06:11.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:11 smithi063 bash[35391]: audit 2024-02-22T19:06:10.937725+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}}, \"last_daemon_update\": \"2024-02-22T19:06:07.655844\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:06:11.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:11 smithi063 bash[35391]: cluster 2024-02-22T19:06:11.455491+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 840 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:11.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[64101]: cluster 2024-02-22T19:06:10.667691+0000 mon.a (mon.0) 312 : cluster [INF] osd.3 [v2:172.21.15.62:6826/1626592673,v1:172.21.15.62:6827/1626592673] boot 2024-02-22T19:06:11.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[64101]: cluster 2024-02-22T19:06:10.667721+0000 mon.a (mon.0) 313 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-22T19:06:11.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[64101]: audit 2024-02-22T19:06:10.668140+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:06:11.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[64101]: audit 2024-02-22T19:06:10.719885+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:06:11.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[64101]: audit 2024-02-22T19:06:10.873964+0000 mgr.y (mgr.14140) 100 : audit [DBG] from='client.34181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:11.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[64101]: cephadm 2024-02-22T19:06:10.874746+0000 mgr.y (mgr.14140) 101 : cephadm [INF] Applying osd on host smithi063... 2024-02-22T19:06:11.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[64101]: audit 2024-02-22T19:06:10.875025+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:06:11.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[64101]: audit 2024-02-22T19:06:10.875627+0000 mon.a (mon.0) 317 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:11.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[64101]: audit 2024-02-22T19:06:10.876454+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:11.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[67442]: cluster 2024-02-22T19:06:10.667691+0000 mon.a (mon.0) 312 : cluster [INF] osd.3 [v2:172.21.15.62:6826/1626592673,v1:172.21.15.62:6827/1626592673] boot 2024-02-22T19:06:11.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[67442]: cluster 2024-02-22T19:06:10.667721+0000 mon.a (mon.0) 313 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-22T19:06:11.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[67442]: audit 2024-02-22T19:06:10.668140+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:06:11.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[67442]: audit 2024-02-22T19:06:10.719885+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:06:11.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[67442]: audit 2024-02-22T19:06:10.873964+0000 mgr.y (mgr.14140) 100 : audit [DBG] from='client.34181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:11.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[67442]: cephadm 2024-02-22T19:06:10.874746+0000 mgr.y (mgr.14140) 101 : cephadm [INF] Applying osd on host smithi063... 2024-02-22T19:06:11.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[67442]: audit 2024-02-22T19:06:10.875025+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:06:11.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[67442]: audit 2024-02-22T19:06:10.875627+0000 mon.a (mon.0) 317 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:11.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[67442]: audit 2024-02-22T19:06:10.876454+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:11.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[64101]: audit 2024-02-22T19:06:10.932778+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}}, \"last_daemon_update\": \"2024-02-22T19:06:07.655844\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:06:11.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[64101]: audit 2024-02-22T19:06:10.937725+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}}, \"last_daemon_update\": \"2024-02-22T19:06:07.655844\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:06:11.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[64101]: cluster 2024-02-22T19:06:11.455491+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 840 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:11.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[67442]: audit 2024-02-22T19:06:10.932778+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}}, \"last_daemon_update\": \"2024-02-22T19:06:07.655844\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:06:11.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[67442]: audit 2024-02-22T19:06:10.937725+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}}, \"last_daemon_update\": \"2024-02-22T19:06:07.655844\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:06:11.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:11 smithi062 bash[67442]: cluster 2024-02-22T19:06:11.455491+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 840 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:13.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:12 smithi063 bash[35391]: cluster 2024-02-22T19:06:11.947619+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-22T19:06:13.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:12 smithi062 bash[64101]: cluster 2024-02-22T19:06:11.947619+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-22T19:06:13.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:12 smithi062 bash[67442]: cluster 2024-02-22T19:06:11.947619+0000 mon.a (mon.0) 321 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-22T19:06:14.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:13 smithi063 bash[35391]: audit 2024-02-22T19:06:13.359144+0000 mon.b (mon.2) 2 : audit [INF] from='client.? 172.21.15.63:0/3282032333' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7fb59916-d40a-4445-a5f8-6d38a8750b27"}]: dispatch 2024-02-22T19:06:14.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:13 smithi063 bash[35391]: audit 2024-02-22T19:06:13.359776+0000 mon.a (mon.0) 322 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7fb59916-d40a-4445-a5f8-6d38a8750b27"}]: dispatch 2024-02-22T19:06:14.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:13 smithi063 bash[35391]: audit 2024-02-22T19:06:13.364221+0000 mon.a (mon.0) 323 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7fb59916-d40a-4445-a5f8-6d38a8750b27"}]': finished 2024-02-22T19:06:14.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:13 smithi063 bash[35391]: cluster 2024-02-22T19:06:13.364302+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2024-02-22T19:06:14.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:13 smithi063 bash[35391]: audit 2024-02-22T19:06:13.364439+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:06:14.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:13 smithi063 bash[35391]: cluster 2024-02-22T19:06:13.455793+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 840 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:14.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:13 smithi062 bash[64101]: audit 2024-02-22T19:06:13.359144+0000 mon.b (mon.2) 2 : audit [INF] from='client.? 172.21.15.63:0/3282032333' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7fb59916-d40a-4445-a5f8-6d38a8750b27"}]: dispatch 2024-02-22T19:06:14.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:13 smithi062 bash[64101]: audit 2024-02-22T19:06:13.359776+0000 mon.a (mon.0) 322 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7fb59916-d40a-4445-a5f8-6d38a8750b27"}]: dispatch 2024-02-22T19:06:14.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:13 smithi062 bash[64101]: audit 2024-02-22T19:06:13.364221+0000 mon.a (mon.0) 323 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7fb59916-d40a-4445-a5f8-6d38a8750b27"}]': finished 2024-02-22T19:06:14.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:13 smithi062 bash[64101]: cluster 2024-02-22T19:06:13.364302+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2024-02-22T19:06:14.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:13 smithi062 bash[64101]: audit 2024-02-22T19:06:13.364439+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:06:14.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:13 smithi062 bash[64101]: cluster 2024-02-22T19:06:13.455793+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 840 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:14.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:13 smithi062 bash[67442]: audit 2024-02-22T19:06:13.359144+0000 mon.b (mon.2) 2 : audit [INF] from='client.? 172.21.15.63:0/3282032333' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7fb59916-d40a-4445-a5f8-6d38a8750b27"}]: dispatch 2024-02-22T19:06:14.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:13 smithi062 bash[67442]: audit 2024-02-22T19:06:13.359776+0000 mon.a (mon.0) 322 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7fb59916-d40a-4445-a5f8-6d38a8750b27"}]: dispatch 2024-02-22T19:06:14.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:13 smithi062 bash[67442]: audit 2024-02-22T19:06:13.364221+0000 mon.a (mon.0) 323 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7fb59916-d40a-4445-a5f8-6d38a8750b27"}]': finished 2024-02-22T19:06:14.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:13 smithi062 bash[67442]: cluster 2024-02-22T19:06:13.364302+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2024-02-22T19:06:14.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:13 smithi062 bash[67442]: audit 2024-02-22T19:06:13.364439+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:06:14.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:13 smithi062 bash[67442]: cluster 2024-02-22T19:06:13.455793+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 840 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:15.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:14 smithi063 bash[35391]: audit 2024-02-22T19:06:14.125194+0000 mon.b (mon.2) 3 : audit [DBG] from='client.? 172.21.15.63:0/3768040869' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:06:15.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:14 smithi062 bash[64101]: audit 2024-02-22T19:06:14.125194+0000 mon.b (mon.2) 3 : audit [DBG] from='client.? 172.21.15.63:0/3768040869' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:06:15.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:14 smithi062 bash[67442]: audit 2024-02-22T19:06:14.125194+0000 mon.b (mon.2) 3 : audit [DBG] from='client.? 172.21.15.63:0/3768040869' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:06:16.626 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:16 smithi063 bash[35391]: cluster 2024-02-22T19:06:15.456114+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 864 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:16.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:16 smithi062 bash[64101]: cluster 2024-02-22T19:06:15.456114+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 864 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:16.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:16 smithi062 bash[67442]: cluster 2024-02-22T19:06:15.456114+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 864 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:17.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:17 smithi063 bash[35391]: audit 2024-02-22T19:06:16.638409+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:17.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:17 smithi062 bash[64101]: audit 2024-02-22T19:06:16.638409+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:17.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:17 smithi062 bash[67442]: audit 2024-02-22T19:06:16.638409+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:18.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:18 smithi063 bash[35391]: cluster 2024-02-22T19:06:17.456473+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 944 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:18.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:18 smithi062 bash[64101]: cluster 2024-02-22T19:06:17.456473+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 944 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:18.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:18 smithi062 bash[67442]: cluster 2024-02-22T19:06:17.456473+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 944 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:20.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:20 smithi063 bash[35391]: cluster 2024-02-22T19:06:19.456972+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:20.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:20 smithi063 bash[35391]: audit 2024-02-22T19:06:19.651424+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-22T19:06:20.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:20 smithi063 bash[35391]: audit 2024-02-22T19:06:19.652204+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:20.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:20 smithi063 bash[35391]: audit 2024-02-22T19:06:19.653091+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2024-02-22T19:06:20.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:20 smithi062 bash[64101]: cluster 2024-02-22T19:06:19.456972+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:20.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:20 smithi062 bash[64101]: audit 2024-02-22T19:06:19.651424+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-22T19:06:20.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:20 smithi062 bash[64101]: audit 2024-02-22T19:06:19.652204+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:20.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:20 smithi062 bash[64101]: audit 2024-02-22T19:06:19.653091+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2024-02-22T19:06:20.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:20 smithi062 bash[67442]: cluster 2024-02-22T19:06:19.456972+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:20.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:20 smithi062 bash[67442]: audit 2024-02-22T19:06:19.651424+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-22T19:06:20.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:20 smithi062 bash[67442]: audit 2024-02-22T19:06:19.652204+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:20.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:20 smithi062 bash[67442]: audit 2024-02-22T19:06:19.653091+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2024-02-22T19:06:21.334 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 4 on host 'smithi063' 2024-02-22T19:06:21.629 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:21 smithi063 bash[35391]: cephadm 2024-02-22T19:06:19.652824+0000 mgr.y (mgr.14140) 107 : cephadm [INF] Deploying daemon osd.4 on smithi063 2024-02-22T19:06:21.629 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:21 smithi063 bash[35391]: audit 2024-02-22T19:06:21.327987+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997210\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997296\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}}, \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:06:21.629 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:21 smithi063 bash[35391]: audit 2024-02-22T19:06:21.328436+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:06:21.629 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:21 smithi063 bash[35391]: audit 2024-02-22T19:06:21.331457+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997210\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997296\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}}, \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:06:21.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:21 smithi062 bash[64101]: cephadm 2024-02-22T19:06:19.652824+0000 mgr.y (mgr.14140) 107 : cephadm [INF] Deploying daemon osd.4 on smithi063 2024-02-22T19:06:21.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:21 smithi062 bash[64101]: audit 2024-02-22T19:06:21.327987+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997210\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997296\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}}, \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:06:21.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:21 smithi062 bash[64101]: audit 2024-02-22T19:06:21.328436+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:06:21.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:21 smithi062 bash[64101]: audit 2024-02-22T19:06:21.331457+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997210\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997296\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}}, \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:06:21.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:21 smithi062 bash[67442]: cephadm 2024-02-22T19:06:19.652824+0000 mgr.y (mgr.14140) 107 : cephadm [INF] Deploying daemon osd.4 on smithi063 2024-02-22T19:06:21.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:21 smithi062 bash[67442]: audit 2024-02-22T19:06:21.327987+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997210\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997296\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}}, \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:06:21.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:21 smithi062 bash[67442]: audit 2024-02-22T19:06:21.328436+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:06:21.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:21 smithi062 bash[67442]: audit 2024-02-22T19:06:21.331457+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997210\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:04:49.997296\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}}, \"last_device_update\": \"2024-02-22T19:04:05.447901\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:06:22.480 DEBUG:teuthology.orchestra.run.smithi063:osd.4> sudo journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.4.service 2024-02-22T19:06:22.483 INFO:tasks.cephadm:Deploying osd.5 on smithi063 with /dev/vg_nvme/lv_3... 2024-02-22T19:06:22.483 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-22T19:06:22.518 INFO:journalctl@ceph.osd.4.smithi063.stdout:-- Logs begin at Thu 2024-02-22 18:41:51 UTC. -- 2024-02-22T19:06:22.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:22 smithi063 bash[35391]: cluster 2024-02-22T19:06:21.457304+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:22.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:22 smithi062 bash[64101]: cluster 2024-02-22T19:06:21.457304+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:22.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:22 smithi062 bash[67442]: cluster 2024-02-22T19:06:21.457304+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:23.214 INFO:journalctl@ceph.osd.4.smithi063.stdout:Feb 22 19:06:22 smithi063 bash[37587]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-22T19:06:23.214 INFO:journalctl@ceph.osd.4.smithi063.stdout:Feb 22 19:06:22 smithi063 bash[37587]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-02-22T19:06:23.214 INFO:journalctl@ceph.osd.4.smithi063.stdout:Feb 22 19:06:22 smithi063 bash[37587]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2024-02-22T19:06:23.214 INFO:journalctl@ceph.osd.4.smithi063.stdout:Feb 22 19:06:22 smithi063 bash[37587]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-02-22T19:06:23.214 INFO:journalctl@ceph.osd.4.smithi063.stdout:Feb 22 19:06:22 smithi063 bash[37587]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-22T19:06:23.214 INFO:journalctl@ceph.osd.4.smithi063.stdout:Feb 22 19:06:22 smithi063 bash[37587]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-22T19:06:23.214 INFO:journalctl@ceph.osd.4.smithi063.stdout:Feb 22 19:06:22 smithi063 bash[37587]: --> ceph-volume lvm activate successful for osd ID: 4 2024-02-22T19:06:24.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:24 smithi063 bash[35391]: cluster 2024-02-22T19:06:23.457771+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:24.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:24 smithi062 bash[64101]: cluster 2024-02-22T19:06:23.457771+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:24.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:24 smithi062 bash[67442]: cluster 2024-02-22T19:06:23.457771+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:25.463 INFO:journalctl@ceph.osd.4.smithi063.stdout:Feb 22 19:06:25 smithi063 bash[37857]: debug 2024-02-22T19:06:25.292+0000 7f0f9da23ec0 -1 Falling back to public interface 2024-02-22T19:06:25.964 INFO:journalctl@ceph.osd.4.smithi063.stdout:Feb 22 19:06:25 smithi063 bash[37857]: debug 2024-02-22T19:06:25.837+0000 7f0f9da23ec0 -1 osd.4 0 log_to_monitors {default=true} 2024-02-22T19:06:26.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:26 smithi063 bash[35391]: cluster 2024-02-22T19:06:25.458243+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:26.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:26 smithi063 bash[35391]: audit 2024-02-22T19:06:25.841357+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.15.63:6800/2291211912,v1:172.21.15.63:6801/2291211912]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-22T19:06:26.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:26 smithi063 bash[35391]: audit 2024-02-22T19:06:25.841749+0000 mon.a (mon.0) 333 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-22T19:06:26.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:26 smithi063 bash[35391]: audit 2024-02-22T19:06:26.283812+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.282972\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283065\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283105\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}}, \"last_daemon_update\": \"2024-02-22T19:06:26.283196\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:06:26.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:26 smithi063 bash[35391]: audit 2024-02-22T19:06:26.287691+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.282972\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283065\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283105\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}}, \"last_daemon_update\": \"2024-02-22T19:06:26.283196\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:06:26.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:26 smithi063 bash[35391]: audit 2024-02-22T19:06:26.288379+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:26.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:26 smithi062 bash[64101]: cluster 2024-02-22T19:06:25.458243+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:26.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:26 smithi062 bash[64101]: audit 2024-02-22T19:06:25.841357+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.15.63:6800/2291211912,v1:172.21.15.63:6801/2291211912]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-22T19:06:26.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:26 smithi062 bash[64101]: audit 2024-02-22T19:06:25.841749+0000 mon.a (mon.0) 333 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-22T19:06:26.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:26 smithi062 bash[67442]: cluster 2024-02-22T19:06:25.458243+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:26.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:26 smithi062 bash[67442]: audit 2024-02-22T19:06:25.841357+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.15.63:6800/2291211912,v1:172.21.15.63:6801/2291211912]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-22T19:06:26.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:26 smithi062 bash[67442]: audit 2024-02-22T19:06:25.841749+0000 mon.a (mon.0) 333 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-22T19:06:26.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:26 smithi062 bash[64101]: audit 2024-02-22T19:06:26.283812+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.282972\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283065\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283105\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}}, \"last_daemon_update\": \"2024-02-22T19:06:26.283196\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:06:26.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:26 smithi062 bash[67442]: audit 2024-02-22T19:06:26.283812+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.282972\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283065\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283105\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}}, \"last_daemon_update\": \"2024-02-22T19:06:26.283196\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:06:26.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:26 smithi062 bash[64101]: audit 2024-02-22T19:06:26.287691+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.282972\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283065\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283105\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}}, \"last_daemon_update\": \"2024-02-22T19:06:26.283196\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:06:26.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:26 smithi062 bash[64101]: audit 2024-02-22T19:06:26.288379+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:26.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:26 smithi062 bash[67442]: audit 2024-02-22T19:06:26.287691+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.282972\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283065\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283105\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}}, \"last_daemon_update\": \"2024-02-22T19:06:26.283196\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:06:26.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:26 smithi062 bash[67442]: audit 2024-02-22T19:06:26.288379+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:26.894 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-22T19:06:26.894 INFO:teuthology.orchestra.run.smithi063.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-22T19:06:26.894 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10+0 records in 2024-02-22T19:06:26.894 INFO:teuthology.orchestra.run.smithi063.stderr:10+0 records out 2024-02-22T19:06:26.894 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126368 s, 830 MB/s 2024-02-22T19:06:26.894 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping successful for: 2024-02-22T19:06:27.714 INFO:journalctl@ceph.osd.4.smithi063.stdout:Feb 22 19:06:27 smithi063 bash[37857]: debug 2024-02-22T19:06:27.452+0000 7f0f827d0700 -1 osd.4 0 waiting for initial osdmap 2024-02-22T19:06:27.714 INFO:journalctl@ceph.osd.4.smithi063.stdout:Feb 22 19:06:27 smithi063 bash[37857]: debug 2024-02-22T19:06:27.457+0000 7f0f8d9ec700 -1 osd.4 30 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-22T19:06:27.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:27 smithi063 bash[35391]: audit 2024-02-22T19:06:26.446445+0000 mon.a (mon.0) 337 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-22T19:06:27.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:27 smithi063 bash[35391]: cluster 2024-02-22T19:06:26.446501+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2024-02-22T19:06:27.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:27 smithi063 bash[35391]: audit 2024-02-22T19:06:26.446987+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:06:27.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:27 smithi063 bash[35391]: audit 2024-02-22T19:06:26.448457+0000 mon.b (mon.2) 5 : audit [INF] from='osd.4 [v2:172.21.15.63:6800/2291211912,v1:172.21.15.63:6801/2291211912]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:06:27.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:27 smithi063 bash[35391]: audit 2024-02-22T19:06:26.448812+0000 mon.a (mon.0) 340 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:06:27.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:27 smithi062 bash[64101]: audit 2024-02-22T19:06:26.446445+0000 mon.a (mon.0) 337 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-22T19:06:27.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:27 smithi062 bash[64101]: cluster 2024-02-22T19:06:26.446501+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2024-02-22T19:06:27.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:27 smithi062 bash[64101]: audit 2024-02-22T19:06:26.446987+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:06:27.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:27 smithi062 bash[64101]: audit 2024-02-22T19:06:26.448457+0000 mon.b (mon.2) 5 : audit [INF] from='osd.4 [v2:172.21.15.63:6800/2291211912,v1:172.21.15.63:6801/2291211912]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:06:27.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:27 smithi062 bash[64101]: audit 2024-02-22T19:06:26.448812+0000 mon.a (mon.0) 340 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:06:27.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:27 smithi062 bash[67442]: audit 2024-02-22T19:06:26.446445+0000 mon.a (mon.0) 337 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-22T19:06:27.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:27 smithi062 bash[67442]: cluster 2024-02-22T19:06:26.446501+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2024-02-22T19:06:27.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:27 smithi062 bash[67442]: audit 2024-02-22T19:06:26.446987+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:06:27.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:27 smithi062 bash[67442]: audit 2024-02-22T19:06:26.448457+0000 mon.b (mon.2) 5 : audit [INF] from='osd.4 [v2:172.21.15.63:6800/2291211912,v1:172.21.15.63:6801/2291211912]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:06:27.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:27 smithi062 bash[67442]: audit 2024-02-22T19:06:26.448812+0000 mon.a (mon.0) 340 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:06:28.477 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph orch daemon add osd smithi063:vg_nvme/lv_3 2024-02-22T19:06:28.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:28 smithi063 bash[35391]: cluster 2024-02-22T19:06:26.851785+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:06:28.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:28 smithi063 bash[35391]: cluster 2024-02-22T19:06:26.851826+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:06:28.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:28 smithi063 bash[35391]: audit 2024-02-22T19:06:27.450580+0000 mon.a (mon.0) 341 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-02-22T19:06:28.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:28 smithi063 bash[35391]: cluster 2024-02-22T19:06:27.450654+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2024-02-22T19:06:28.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:28 smithi063 bash[35391]: audit 2024-02-22T19:06:27.452234+0000 mon.a (mon.0) 343 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:06:28.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:28 smithi063 bash[35391]: cluster 2024-02-22T19:06:27.458567+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:28.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:28 smithi063 bash[35391]: cluster 2024-02-22T19:06:28.450384+0000 mon.a (mon.0) 344 : cluster [INF] osd.4 [v2:172.21.15.63:6800/2291211912,v1:172.21.15.63:6801/2291211912] boot 2024-02-22T19:06:28.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:28 smithi063 bash[35391]: cluster 2024-02-22T19:06:28.450443+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-02-22T19:06:28.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:28 smithi062 bash[64101]: cluster 2024-02-22T19:06:26.851785+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:06:28.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:28 smithi062 bash[64101]: cluster 2024-02-22T19:06:26.851826+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:06:28.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:28 smithi062 bash[64101]: audit 2024-02-22T19:06:27.450580+0000 mon.a (mon.0) 341 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-02-22T19:06:28.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:28 smithi062 bash[64101]: cluster 2024-02-22T19:06:27.450654+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2024-02-22T19:06:28.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:28 smithi062 bash[64101]: audit 2024-02-22T19:06:27.452234+0000 mon.a (mon.0) 343 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:06:28.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:28 smithi062 bash[64101]: cluster 2024-02-22T19:06:27.458567+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:28.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:28 smithi062 bash[64101]: cluster 2024-02-22T19:06:28.450384+0000 mon.a (mon.0) 344 : cluster [INF] osd.4 [v2:172.21.15.63:6800/2291211912,v1:172.21.15.63:6801/2291211912] boot 2024-02-22T19:06:28.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:28 smithi062 bash[64101]: cluster 2024-02-22T19:06:28.450443+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-02-22T19:06:28.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:28 smithi062 bash[67442]: cluster 2024-02-22T19:06:26.851785+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:06:28.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:28 smithi062 bash[67442]: cluster 2024-02-22T19:06:26.851826+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:06:28.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:28 smithi062 bash[67442]: audit 2024-02-22T19:06:27.450580+0000 mon.a (mon.0) 341 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-02-22T19:06:28.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:28 smithi062 bash[67442]: cluster 2024-02-22T19:06:27.450654+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2024-02-22T19:06:28.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:28 smithi062 bash[67442]: audit 2024-02-22T19:06:27.452234+0000 mon.a (mon.0) 343 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:06:28.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:28 smithi062 bash[67442]: cluster 2024-02-22T19:06:27.458567+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-22T19:06:28.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:28 smithi062 bash[67442]: cluster 2024-02-22T19:06:28.450384+0000 mon.a (mon.0) 344 : cluster [INF] osd.4 [v2:172.21.15.63:6800/2291211912,v1:172.21.15.63:6801/2291211912] boot 2024-02-22T19:06:28.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:28 smithi062 bash[67442]: cluster 2024-02-22T19:06:28.450443+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-02-22T19:06:29.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:29 smithi063 bash[35391]: audit 2024-02-22T19:06:28.455695+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:06:29.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:29 smithi063 bash[35391]: cluster 2024-02-22T19:06:29.452287+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-22T19:06:29.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:29 smithi062 bash[64101]: audit 2024-02-22T19:06:28.455695+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:06:29.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:29 smithi062 bash[64101]: cluster 2024-02-22T19:06:29.452287+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-22T19:06:29.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:29 smithi062 bash[67442]: audit 2024-02-22T19:06:28.455695+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:06:29.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:29 smithi062 bash[67442]: cluster 2024-02-22T19:06:29.452287+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-22T19:06:30.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:30 smithi063 bash[35391]: cluster 2024-02-22T19:06:29.458806+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail 2024-02-22T19:06:30.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:30 smithi062 bash[64101]: cluster 2024-02-22T19:06:29.458806+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail 2024-02-22T19:06:30.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:30 smithi062 bash[67442]: cluster 2024-02-22T19:06:29.458806+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail 2024-02-22T19:06:31.519 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:31 smithi063 bash[35391]: audit 2024-02-22T19:06:30.723496+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:06:31.519 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:31 smithi063 bash[35391]: audit 2024-02-22T19:06:30.937520+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.282972\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283065\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283105\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}}, \"last_daemon_update\": \"2024-02-22T19:06:26.283196\", \"last_device_update\": \"2024-02-22T19:06:30.936985\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:06:31.519 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:31 smithi063 bash[35391]: audit 2024-02-22T19:06:30.940695+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.282972\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283065\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283105\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}}, \"last_daemon_update\": \"2024-02-22T19:06:26.283196\", \"last_device_update\": \"2024-02-22T19:06:30.936985\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:06:31.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:31 smithi062 bash[64101]: audit 2024-02-22T19:06:30.723496+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:06:31.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:31 smithi062 bash[67442]: audit 2024-02-22T19:06:30.723496+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:06:31.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:31 smithi062 bash[64101]: audit 2024-02-22T19:06:30.937520+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.282972\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283065\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283105\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}}, \"last_daemon_update\": \"2024-02-22T19:06:26.283196\", \"last_device_update\": \"2024-02-22T19:06:30.936985\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:06:31.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:31 smithi062 bash[64101]: audit 2024-02-22T19:06:30.940695+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.282972\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283065\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283105\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}}, \"last_daemon_update\": \"2024-02-22T19:06:26.283196\", \"last_device_update\": \"2024-02-22T19:06:30.936985\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:06:31.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:31 smithi062 bash[67442]: audit 2024-02-22T19:06:30.937520+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.282972\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283065\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283105\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}}, \"last_daemon_update\": \"2024-02-22T19:06:26.283196\", \"last_device_update\": \"2024-02-22T19:06:30.936985\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:06:31.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:31 smithi062 bash[67442]: audit 2024-02-22T19:06:30.940695+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.282972\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283065\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283105\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}}, \"last_daemon_update\": \"2024-02-22T19:06:26.283196\", \"last_device_update\": \"2024-02-22T19:06:30.936985\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:06:32.627 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:32 smithi063 bash[35391]: cluster 2024-02-22T19:06:31.459202+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:32.627 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:32 smithi063 bash[35391]: audit 2024-02-22T19:06:31.898408+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:06:32.627 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:32 smithi063 bash[35391]: audit 2024-02-22T19:06:31.899216+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:32.627 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:32 smithi063 bash[35391]: audit 2024-02-22T19:06:31.900375+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:32.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:32 smithi062 bash[64101]: cluster 2024-02-22T19:06:31.459202+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:32.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:32 smithi062 bash[64101]: audit 2024-02-22T19:06:31.898408+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:06:32.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:32 smithi062 bash[64101]: audit 2024-02-22T19:06:31.899216+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:32.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:32 smithi062 bash[64101]: audit 2024-02-22T19:06:31.900375+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:32.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:32 smithi062 bash[67442]: cluster 2024-02-22T19:06:31.459202+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:32.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:32 smithi062 bash[67442]: audit 2024-02-22T19:06:31.898408+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:06:32.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:32 smithi062 bash[67442]: audit 2024-02-22T19:06:31.899216+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:32.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:32 smithi062 bash[67442]: audit 2024-02-22T19:06:31.900375+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:33.731 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:33 smithi063 bash[35391]: audit 2024-02-22T19:06:31.897193+0000 mgr.y (mgr.14140) 114 : audit [DBG] from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:33.731 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:33 smithi063 bash[35391]: cephadm 2024-02-22T19:06:31.898080+0000 mgr.y (mgr.14140) 115 : cephadm [INF] Applying osd on host smithi063... 2024-02-22T19:06:33.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:33 smithi062 bash[64101]: audit 2024-02-22T19:06:31.897193+0000 mgr.y (mgr.14140) 114 : audit [DBG] from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:33.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:33 smithi062 bash[64101]: cephadm 2024-02-22T19:06:31.898080+0000 mgr.y (mgr.14140) 115 : cephadm [INF] Applying osd on host smithi063... 2024-02-22T19:06:33.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:33 smithi062 bash[67442]: audit 2024-02-22T19:06:31.897193+0000 mgr.y (mgr.14140) 114 : audit [DBG] from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:33.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:33 smithi062 bash[67442]: cephadm 2024-02-22T19:06:31.898080+0000 mgr.y (mgr.14140) 115 : cephadm [INF] Applying osd on host smithi063... 2024-02-22T19:06:34.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:34 smithi062 bash[64101]: cluster 2024-02-22T19:06:33.459687+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:34.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:34 smithi062 bash[64101]: audit 2024-02-22T19:06:34.384954+0000 mon.b (mon.2) 6 : audit [INF] from='client.? 172.21.15.63:0/986496782' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f67bd7fb-661e-4746-a736-7faf48782399"}]: dispatch 2024-02-22T19:06:34.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:34 smithi062 bash[64101]: audit 2024-02-22T19:06:34.385499+0000 mon.a (mon.0) 354 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f67bd7fb-661e-4746-a736-7faf48782399"}]: dispatch 2024-02-22T19:06:34.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:34 smithi062 bash[64101]: audit 2024-02-22T19:06:34.389679+0000 mon.a (mon.0) 355 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f67bd7fb-661e-4746-a736-7faf48782399"}]': finished 2024-02-22T19:06:34.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:34 smithi062 bash[64101]: cluster 2024-02-22T19:06:34.389737+0000 mon.a (mon.0) 356 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2024-02-22T19:06:34.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:34 smithi062 bash[64101]: audit 2024-02-22T19:06:34.389920+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:06:34.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:34 smithi062 bash[67442]: cluster 2024-02-22T19:06:33.459687+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:34.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:34 smithi062 bash[67442]: audit 2024-02-22T19:06:34.384954+0000 mon.b (mon.2) 6 : audit [INF] from='client.? 172.21.15.63:0/986496782' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f67bd7fb-661e-4746-a736-7faf48782399"}]: dispatch 2024-02-22T19:06:34.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:34 smithi062 bash[67442]: audit 2024-02-22T19:06:34.385499+0000 mon.a (mon.0) 354 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f67bd7fb-661e-4746-a736-7faf48782399"}]: dispatch 2024-02-22T19:06:34.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:34 smithi062 bash[67442]: audit 2024-02-22T19:06:34.389679+0000 mon.a (mon.0) 355 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f67bd7fb-661e-4746-a736-7faf48782399"}]': finished 2024-02-22T19:06:34.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:34 smithi062 bash[67442]: cluster 2024-02-22T19:06:34.389737+0000 mon.a (mon.0) 356 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2024-02-22T19:06:34.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:34 smithi062 bash[67442]: audit 2024-02-22T19:06:34.389920+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:06:34.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:34 smithi063 bash[35391]: cluster 2024-02-22T19:06:33.459687+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:34.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:34 smithi063 bash[35391]: audit 2024-02-22T19:06:34.384954+0000 mon.b (mon.2) 6 : audit [INF] from='client.? 172.21.15.63:0/986496782' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f67bd7fb-661e-4746-a736-7faf48782399"}]: dispatch 2024-02-22T19:06:34.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:34 smithi063 bash[35391]: audit 2024-02-22T19:06:34.385499+0000 mon.a (mon.0) 354 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f67bd7fb-661e-4746-a736-7faf48782399"}]: dispatch 2024-02-22T19:06:34.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:34 smithi063 bash[35391]: audit 2024-02-22T19:06:34.389679+0000 mon.a (mon.0) 355 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f67bd7fb-661e-4746-a736-7faf48782399"}]': finished 2024-02-22T19:06:34.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:34 smithi063 bash[35391]: cluster 2024-02-22T19:06:34.389737+0000 mon.a (mon.0) 356 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2024-02-22T19:06:34.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:34 smithi063 bash[35391]: audit 2024-02-22T19:06:34.389920+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:06:35.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:35 smithi063 bash[35391]: audit 2024-02-22T19:06:35.149442+0000 mon.b (mon.2) 7 : audit [DBG] from='client.? 172.21.15.63:0/3092419209' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:06:35.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:35 smithi062 bash[64101]: audit 2024-02-22T19:06:35.149442+0000 mon.b (mon.2) 7 : audit [DBG] from='client.? 172.21.15.63:0/3092419209' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:06:35.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:35 smithi062 bash[67442]: audit 2024-02-22T19:06:35.149442+0000 mon.b (mon.2) 7 : audit [DBG] from='client.? 172.21.15.63:0/3092419209' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:06:36.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:36 smithi063 bash[35391]: cluster 2024-02-22T19:06:35.460159+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:36.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:36 smithi062 bash[64101]: cluster 2024-02-22T19:06:35.460159+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:36.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:36 smithi062 bash[67442]: cluster 2024-02-22T19:06:35.460159+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:38.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:38 smithi063 bash[35391]: cluster 2024-02-22T19:06:37.460679+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:38.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:38 smithi063 bash[35391]: audit 2024-02-22T19:06:37.793617+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:38.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:38 smithi062 bash[64101]: cluster 2024-02-22T19:06:37.460679+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:38.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:38 smithi062 bash[64101]: audit 2024-02-22T19:06:37.793617+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:38.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:38 smithi062 bash[67442]: cluster 2024-02-22T19:06:37.460679+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:38.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:38 smithi062 bash[67442]: audit 2024-02-22T19:06:37.793617+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:40.922 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:40 smithi063 bash[35391]: cluster 2024-02-22T19:06:39.461057+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:40.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:40 smithi062 bash[64101]: cluster 2024-02-22T19:06:39.461057+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:40.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:40 smithi062 bash[67442]: cluster 2024-02-22T19:06:39.461057+0000 mgr.y (mgr.14140) 119 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-22T19:06:41.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:41 smithi063 bash[35391]: audit 2024-02-22T19:06:40.520173+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-22T19:06:41.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:41 smithi063 bash[35391]: audit 2024-02-22T19:06:40.520943+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:41.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:41 smithi063 bash[35391]: cephadm 2024-02-22T19:06:40.521517+0000 mgr.y (mgr.14140) 120 : cephadm [INF] Deploying daemon osd.5 on smithi063 2024-02-22T19:06:41.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:41 smithi063 bash[35391]: audit 2024-02-22T19:06:40.521807+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2024-02-22T19:06:41.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:41 smithi062 bash[64101]: audit 2024-02-22T19:06:40.520173+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-22T19:06:41.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:41 smithi062 bash[64101]: audit 2024-02-22T19:06:40.520943+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:41.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:41 smithi062 bash[64101]: cephadm 2024-02-22T19:06:40.521517+0000 mgr.y (mgr.14140) 120 : cephadm [INF] Deploying daemon osd.5 on smithi063 2024-02-22T19:06:41.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:41 smithi062 bash[64101]: audit 2024-02-22T19:06:40.521807+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2024-02-22T19:06:41.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:41 smithi062 bash[67442]: audit 2024-02-22T19:06:40.520173+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-22T19:06:41.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:41 smithi062 bash[67442]: audit 2024-02-22T19:06:40.520943+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:41.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:41 smithi062 bash[67442]: cephadm 2024-02-22T19:06:40.521517+0000 mgr.y (mgr.14140) 120 : cephadm [INF] Deploying daemon osd.5 on smithi063 2024-02-22T19:06:41.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:41 smithi062 bash[67442]: audit 2024-02-22T19:06:40.521807+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2024-02-22T19:06:42.143 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 5 on host 'smithi063' 2024-02-22T19:06:42.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:42 smithi063 bash[35391]: cluster 2024-02-22T19:06:41.461485+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T19:06:42.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:42 smithi063 bash[35391]: audit 2024-02-22T19:06:42.136936+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.282972\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283065\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283105\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}}, \"last_device_update\": \"2024-02-22T19:06:30.936985\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:06:42.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:42 smithi063 bash[35391]: audit 2024-02-22T19:06:42.137424+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:06:42.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:42 smithi063 bash[35391]: audit 2024-02-22T19:06:42.140276+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.282972\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283065\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283105\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}}, \"last_device_update\": \"2024-02-22T19:06:30.936985\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:06:42.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:42 smithi062 bash[64101]: cluster 2024-02-22T19:06:41.461485+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T19:06:42.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:42 smithi062 bash[67442]: cluster 2024-02-22T19:06:41.461485+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T19:06:42.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:42 smithi062 bash[64101]: audit 2024-02-22T19:06:42.136936+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.282972\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283065\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283105\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}}, \"last_device_update\": \"2024-02-22T19:06:30.936985\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:06:42.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:42 smithi062 bash[64101]: audit 2024-02-22T19:06:42.137424+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:06:42.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:42 smithi062 bash[64101]: audit 2024-02-22T19:06:42.140276+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.282972\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283065\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283105\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}}, \"last_device_update\": \"2024-02-22T19:06:30.936985\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:06:42.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:42 smithi062 bash[67442]: audit 2024-02-22T19:06:42.136936+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.282972\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283065\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283105\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}}, \"last_device_update\": \"2024-02-22T19:06:30.936985\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:06:42.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:42 smithi062 bash[67442]: audit 2024-02-22T19:06:42.137424+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:06:42.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:42 smithi062 bash[67442]: audit 2024-02-22T19:06:42.140276+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.282972\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283065\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:26.283105\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}}, \"last_device_update\": \"2024-02-22T19:06:30.936985\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:06:43.352 DEBUG:teuthology.orchestra.run.smithi063:osd.5> sudo journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.5.service 2024-02-22T19:06:43.355 INFO:tasks.cephadm:Deploying osd.6 on smithi063 with /dev/vg_nvme/lv_2... 2024-02-22T19:06:43.355 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-22T19:06:43.384 INFO:journalctl@ceph.osd.5.smithi063.stdout:-- Logs begin at Thu 2024-02-22 18:41:51 UTC. -- 2024-02-22T19:06:44.946 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:44 smithi063 bash[35391]: cluster 2024-02-22T19:06:43.461834+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T19:06:44.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:44 smithi062 bash[64101]: cluster 2024-02-22T19:06:43.461834+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T19:06:44.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:44 smithi062 bash[67442]: cluster 2024-02-22T19:06:43.461834+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T19:06:46.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:46 smithi063 bash[35391]: cluster 2024-02-22T19:06:45.462291+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T19:06:46.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:46 smithi063 bash[35391]: audit 2024-02-22T19:06:45.471982+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-22T19:06:46.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:46 smithi063 bash[35391]: audit 2024-02-22T19:06:45.475047+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-22T19:06:46.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:46 smithi062 bash[67442]: cluster 2024-02-22T19:06:45.462291+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T19:06:46.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:46 smithi062 bash[67442]: audit 2024-02-22T19:06:45.471982+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-22T19:06:46.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:46 smithi062 bash[67442]: audit 2024-02-22T19:06:45.475047+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-22T19:06:46.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:46 smithi062 bash[64101]: cluster 2024-02-22T19:06:45.462291+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T19:06:46.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:46 smithi062 bash[64101]: audit 2024-02-22T19:06:45.471982+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-22T19:06:46.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:46 smithi062 bash[64101]: audit 2024-02-22T19:06:45.475047+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-22T19:06:47.167 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-22T19:06:47.167 INFO:teuthology.orchestra.run.smithi063.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-22T19:06:47.167 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10+0 records in 2024-02-22T19:06:47.167 INFO:teuthology.orchestra.run.smithi063.stderr:10+0 records out 2024-02-22T19:06:47.167 INFO:teuthology.orchestra.run.smithi063.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0120628 s, 869 MB/s 2024-02-22T19:06:47.167 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping successful for: 2024-02-22T19:06:47.203 INFO:journalctl@ceph.osd.5.smithi063.stdout:Feb 22 19:06:46 smithi063 bash[39339]: debug 2024-02-22T19:06:46.715+0000 7f8ea7d9bec0 -1 Falling back to public interface 2024-02-22T19:06:47.463 INFO:journalctl@ceph.osd.5.smithi063.stdout:Feb 22 19:06:47 smithi063 bash[39339]: debug 2024-02-22T19:06:47.269+0000 7f8ea7d9bec0 -1 osd.5 0 log_to_monitors {default=true} 2024-02-22T19:06:47.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:47 smithi063 bash[35391]: audit 2024-02-22T19:06:47.027794+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026880\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026974\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027015\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027050\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}}, \"last_daemon_update\": \"2024-02-22T19:06:47.027141\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:06:47.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:47 smithi063 bash[35391]: audit 2024-02-22T19:06:47.030786+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026880\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026974\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027015\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027050\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}}, \"last_daemon_update\": \"2024-02-22T19:06:47.027141\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:06:47.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:47 smithi063 bash[35391]: audit 2024-02-22T19:06:47.031504+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:47.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:47 smithi063 bash[35391]: audit 2024-02-22T19:06:47.273074+0000 mon.b (mon.2) 8 : audit [INF] from='osd.5 [v2:172.21.15.63:6808/1349972101,v1:172.21.15.63:6809/1349972101]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-22T19:06:47.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:47 smithi063 bash[35391]: audit 2024-02-22T19:06:47.273519+0000 mon.a (mon.0) 370 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-22T19:06:47.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:47 smithi062 bash[64101]: audit 2024-02-22T19:06:47.027794+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026880\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026974\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027015\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027050\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}}, \"last_daemon_update\": \"2024-02-22T19:06:47.027141\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:06:47.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:47 smithi062 bash[67442]: audit 2024-02-22T19:06:47.027794+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026880\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026974\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027015\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027050\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}}, \"last_daemon_update\": \"2024-02-22T19:06:47.027141\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:06:47.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:47 smithi062 bash[64101]: audit 2024-02-22T19:06:47.030786+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026880\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026974\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027015\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027050\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}}, \"last_daemon_update\": \"2024-02-22T19:06:47.027141\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:06:47.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:47 smithi062 bash[64101]: audit 2024-02-22T19:06:47.031504+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:47.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:47 smithi062 bash[64101]: audit 2024-02-22T19:06:47.273074+0000 mon.b (mon.2) 8 : audit [INF] from='osd.5 [v2:172.21.15.63:6808/1349972101,v1:172.21.15.63:6809/1349972101]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-22T19:06:47.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:47 smithi062 bash[64101]: audit 2024-02-22T19:06:47.273519+0000 mon.a (mon.0) 370 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-22T19:06:47.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:47 smithi062 bash[67442]: audit 2024-02-22T19:06:47.030786+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026880\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026974\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027015\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027050\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}}, \"last_daemon_update\": \"2024-02-22T19:06:47.027141\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:06:47.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:47 smithi062 bash[67442]: audit 2024-02-22T19:06:47.031504+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:47.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:47 smithi062 bash[67442]: audit 2024-02-22T19:06:47.273074+0000 mon.b (mon.2) 8 : audit [INF] from='osd.5 [v2:172.21.15.63:6808/1349972101,v1:172.21.15.63:6809/1349972101]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-22T19:06:47.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:47 smithi062 bash[67442]: audit 2024-02-22T19:06:47.273519+0000 mon.a (mon.0) 370 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-22T19:06:47.861 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph orch daemon add osd smithi063:vg_nvme/lv_2 2024-02-22T19:06:48.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:48 smithi063 bash[35391]: cluster 2024-02-22T19:06:47.462764+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T19:06:48.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:48 smithi063 bash[35391]: audit 2024-02-22T19:06:48.034426+0000 mon.a (mon.0) 371 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-22T19:06:48.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:48 smithi063 bash[35391]: cluster 2024-02-22T19:06:48.034491+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2024-02-22T19:06:48.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:48 smithi063 bash[35391]: audit 2024-02-22T19:06:48.034669+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:06:48.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:48 smithi063 bash[35391]: audit 2024-02-22T19:06:48.034932+0000 mon.b (mon.2) 9 : audit [INF] from='osd.5 [v2:172.21.15.63:6808/1349972101,v1:172.21.15.63:6809/1349972101]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:06:48.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:48 smithi063 bash[35391]: audit 2024-02-22T19:06:48.035254+0000 mon.a (mon.0) 374 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:06:48.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:48 smithi063 bash[35391]: cluster 2024-02-22T19:06:48.236678+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:06:48.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:48 smithi063 bash[35391]: cluster 2024-02-22T19:06:48.236720+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:06:48.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:48 smithi062 bash[64101]: cluster 2024-02-22T19:06:47.462764+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T19:06:48.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:48 smithi062 bash[64101]: audit 2024-02-22T19:06:48.034426+0000 mon.a (mon.0) 371 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-22T19:06:48.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:48 smithi062 bash[64101]: cluster 2024-02-22T19:06:48.034491+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2024-02-22T19:06:48.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:48 smithi062 bash[64101]: audit 2024-02-22T19:06:48.034669+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:06:48.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:48 smithi062 bash[64101]: audit 2024-02-22T19:06:48.034932+0000 mon.b (mon.2) 9 : audit [INF] from='osd.5 [v2:172.21.15.63:6808/1349972101,v1:172.21.15.63:6809/1349972101]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:06:48.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:48 smithi062 bash[64101]: audit 2024-02-22T19:06:48.035254+0000 mon.a (mon.0) 374 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:06:48.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:48 smithi062 bash[64101]: cluster 2024-02-22T19:06:48.236678+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:06:48.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:48 smithi062 bash[64101]: cluster 2024-02-22T19:06:48.236720+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:06:48.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:48 smithi062 bash[67442]: cluster 2024-02-22T19:06:47.462764+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T19:06:48.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:48 smithi062 bash[67442]: audit 2024-02-22T19:06:48.034426+0000 mon.a (mon.0) 371 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-22T19:06:48.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:48 smithi062 bash[67442]: cluster 2024-02-22T19:06:48.034491+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2024-02-22T19:06:48.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:48 smithi062 bash[67442]: audit 2024-02-22T19:06:48.034669+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:06:48.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:48 smithi062 bash[67442]: audit 2024-02-22T19:06:48.034932+0000 mon.b (mon.2) 9 : audit [INF] from='osd.5 [v2:172.21.15.63:6808/1349972101,v1:172.21.15.63:6809/1349972101]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:06:48.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:48 smithi062 bash[67442]: audit 2024-02-22T19:06:48.035254+0000 mon.a (mon.0) 374 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:06:48.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:48 smithi062 bash[67442]: cluster 2024-02-22T19:06:48.236678+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:06:48.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:48 smithi062 bash[67442]: cluster 2024-02-22T19:06:48.236720+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:06:49.214 INFO:journalctl@ceph.osd.5.smithi063.stdout:Feb 22 19:06:49 smithi063 bash[39339]: debug 2024-02-22T19:06:49.038+0000 7f8e90b50700 -1 osd.5 0 waiting for initial osdmap 2024-02-22T19:06:49.214 INFO:journalctl@ceph.osd.5.smithi063.stdout:Feb 22 19:06:49 smithi063 bash[39339]: debug 2024-02-22T19:06:49.044+0000 7f8e9bd6c700 -1 osd.5 35 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-22T19:06:50.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:50 smithi063 bash[35391]: audit 2024-02-22T19:06:49.036783+0000 mon.a (mon.0) 375 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-02-22T19:06:50.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:50 smithi063 bash[35391]: cluster 2024-02-22T19:06:49.036854+0000 mon.a (mon.0) 376 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2024-02-22T19:06:50.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:50 smithi063 bash[35391]: audit 2024-02-22T19:06:49.037070+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:06:50.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:50 smithi063 bash[35391]: cluster 2024-02-22T19:06:49.463226+0000 mgr.y (mgr.14140) 125 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T19:06:50.484 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:50 smithi062 bash[67442]: audit 2024-02-22T19:06:49.036783+0000 mon.a (mon.0) 375 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-02-22T19:06:50.484 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:50 smithi062 bash[67442]: cluster 2024-02-22T19:06:49.036854+0000 mon.a (mon.0) 376 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2024-02-22T19:06:50.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:50 smithi062 bash[67442]: audit 2024-02-22T19:06:49.037070+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:06:50.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:50 smithi062 bash[67442]: cluster 2024-02-22T19:06:49.463226+0000 mgr.y (mgr.14140) 125 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T19:06:50.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:50 smithi062 bash[64101]: audit 2024-02-22T19:06:49.036783+0000 mon.a (mon.0) 375 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-02-22T19:06:50.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:50 smithi062 bash[64101]: cluster 2024-02-22T19:06:49.036854+0000 mon.a (mon.0) 376 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2024-02-22T19:06:50.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:50 smithi062 bash[64101]: audit 2024-02-22T19:06:49.037070+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:06:50.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:50 smithi062 bash[64101]: cluster 2024-02-22T19:06:49.463226+0000 mgr.y (mgr.14140) 125 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-22T19:06:51.328 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:51 smithi063 bash[35391]: cluster 2024-02-22T19:06:50.041830+0000 mon.a (mon.0) 378 : cluster [INF] osd.5 [v2:172.21.15.63:6808/1349972101,v1:172.21.15.63:6809/1349972101] boot 2024-02-22T19:06:51.328 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:51 smithi063 bash[35391]: cluster 2024-02-22T19:06:50.041907+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2024-02-22T19:06:51.328 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:51 smithi063 bash[35391]: audit 2024-02-22T19:06:50.042344+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:06:51.328 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:51 smithi063 bash[35391]: audit 2024-02-22T19:06:50.480005+0000 mgr.y (mgr.14140) 126 : audit [DBG] from='client.34235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:51.328 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:51 smithi063 bash[35391]: cephadm 2024-02-22T19:06:50.480858+0000 mgr.y (mgr.14140) 127 : cephadm [INF] Applying osd on host smithi063... 2024-02-22T19:06:51.328 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:51 smithi063 bash[35391]: audit 2024-02-22T19:06:50.481204+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:06:51.328 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:51 smithi063 bash[35391]: audit 2024-02-22T19:06:50.482022+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:51.329 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:51 smithi063 bash[35391]: audit 2024-02-22T19:06:50.483250+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:51.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:51 smithi062 bash[64101]: cluster 2024-02-22T19:06:50.041830+0000 mon.a (mon.0) 378 : cluster [INF] osd.5 [v2:172.21.15.63:6808/1349972101,v1:172.21.15.63:6809/1349972101] boot 2024-02-22T19:06:51.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:51 smithi062 bash[64101]: cluster 2024-02-22T19:06:50.041907+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2024-02-22T19:06:51.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:51 smithi062 bash[64101]: audit 2024-02-22T19:06:50.042344+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:06:51.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:51 smithi062 bash[64101]: audit 2024-02-22T19:06:50.480005+0000 mgr.y (mgr.14140) 126 : audit [DBG] from='client.34235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:51.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:51 smithi062 bash[64101]: cephadm 2024-02-22T19:06:50.480858+0000 mgr.y (mgr.14140) 127 : cephadm [INF] Applying osd on host smithi063... 2024-02-22T19:06:51.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:51 smithi062 bash[64101]: audit 2024-02-22T19:06:50.481204+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:06:51.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:51 smithi062 bash[64101]: audit 2024-02-22T19:06:50.482022+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:51.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:51 smithi062 bash[64101]: audit 2024-02-22T19:06:50.483250+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:51.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:51 smithi062 bash[67442]: cluster 2024-02-22T19:06:50.041830+0000 mon.a (mon.0) 378 : cluster [INF] osd.5 [v2:172.21.15.63:6808/1349972101,v1:172.21.15.63:6809/1349972101] boot 2024-02-22T19:06:51.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:51 smithi062 bash[67442]: cluster 2024-02-22T19:06:50.041907+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2024-02-22T19:06:51.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:51 smithi062 bash[67442]: audit 2024-02-22T19:06:50.042344+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:06:51.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:51 smithi062 bash[67442]: audit 2024-02-22T19:06:50.480005+0000 mgr.y (mgr.14140) 126 : audit [DBG] from='client.34235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:06:51.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:51 smithi062 bash[67442]: cephadm 2024-02-22T19:06:50.480858+0000 mgr.y (mgr.14140) 127 : cephadm [INF] Applying osd on host smithi063... 2024-02-22T19:06:51.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:51 smithi062 bash[67442]: audit 2024-02-22T19:06:50.481204+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:06:51.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:51 smithi062 bash[67442]: audit 2024-02-22T19:06:50.482022+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:51.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:51 smithi062 bash[67442]: audit 2024-02-22T19:06:50.483250+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:52.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:52 smithi063 bash[35391]: cluster 2024-02-22T19:06:51.042146+0000 mon.a (mon.0) 384 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-22T19:06:52.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:52 smithi063 bash[35391]: cluster 2024-02-22T19:06:51.463616+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v128: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:06:52.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:52 smithi062 bash[64101]: cluster 2024-02-22T19:06:51.042146+0000 mon.a (mon.0) 384 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-22T19:06:52.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:52 smithi062 bash[64101]: cluster 2024-02-22T19:06:51.463616+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v128: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:06:52.484 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:52 smithi062 bash[67442]: cluster 2024-02-22T19:06:51.042146+0000 mon.a (mon.0) 384 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-22T19:06:52.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:52 smithi062 bash[67442]: cluster 2024-02-22T19:06:51.463616+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v128: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:06:53.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:53 smithi063 bash[35391]: cluster 2024-02-22T19:06:52.045870+0000 mon.a (mon.0) 385 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-22T19:06:53.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:53 smithi063 bash[35391]: audit 2024-02-22T19:06:53.005206+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.15.63:0/3992535725' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0228dda5-c78b-479f-a7a0-4fe88baed26d"}]: dispatch 2024-02-22T19:06:53.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:53 smithi063 bash[35391]: audit 2024-02-22T19:06:53.005707+0000 mon.a (mon.0) 386 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0228dda5-c78b-479f-a7a0-4fe88baed26d"}]: dispatch 2024-02-22T19:06:53.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:53 smithi063 bash[35391]: audit 2024-02-22T19:06:53.016572+0000 mon.a (mon.0) 387 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0228dda5-c78b-479f-a7a0-4fe88baed26d"}]': finished 2024-02-22T19:06:53.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:53 smithi063 bash[35391]: cluster 2024-02-22T19:06:53.016722+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2024-02-22T19:06:53.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:53 smithi063 bash[35391]: audit 2024-02-22T19:06:53.016887+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:06:53.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:53 smithi062 bash[64101]: cluster 2024-02-22T19:06:52.045870+0000 mon.a (mon.0) 385 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-22T19:06:53.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:53 smithi062 bash[64101]: audit 2024-02-22T19:06:53.005206+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.15.63:0/3992535725' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0228dda5-c78b-479f-a7a0-4fe88baed26d"}]: dispatch 2024-02-22T19:06:53.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:53 smithi062 bash[64101]: audit 2024-02-22T19:06:53.005707+0000 mon.a (mon.0) 386 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0228dda5-c78b-479f-a7a0-4fe88baed26d"}]: dispatch 2024-02-22T19:06:53.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:53 smithi062 bash[64101]: audit 2024-02-22T19:06:53.016572+0000 mon.a (mon.0) 387 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0228dda5-c78b-479f-a7a0-4fe88baed26d"}]': finished 2024-02-22T19:06:53.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:53 smithi062 bash[64101]: cluster 2024-02-22T19:06:53.016722+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2024-02-22T19:06:53.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:53 smithi062 bash[64101]: audit 2024-02-22T19:06:53.016887+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:06:53.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:53 smithi062 bash[67442]: cluster 2024-02-22T19:06:52.045870+0000 mon.a (mon.0) 385 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-22T19:06:53.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:53 smithi062 bash[67442]: audit 2024-02-22T19:06:53.005206+0000 mon.b (mon.2) 10 : audit [INF] from='client.? 172.21.15.63:0/3992535725' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0228dda5-c78b-479f-a7a0-4fe88baed26d"}]: dispatch 2024-02-22T19:06:53.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:53 smithi062 bash[67442]: audit 2024-02-22T19:06:53.005707+0000 mon.a (mon.0) 386 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0228dda5-c78b-479f-a7a0-4fe88baed26d"}]: dispatch 2024-02-22T19:06:53.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:53 smithi062 bash[67442]: audit 2024-02-22T19:06:53.016572+0000 mon.a (mon.0) 387 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0228dda5-c78b-479f-a7a0-4fe88baed26d"}]': finished 2024-02-22T19:06:53.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:53 smithi062 bash[67442]: cluster 2024-02-22T19:06:53.016722+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2024-02-22T19:06:53.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:53 smithi062 bash[67442]: audit 2024-02-22T19:06:53.016887+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:06:54.401 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:54 smithi063 bash[35391]: cluster 2024-02-22T19:06:53.464026+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v130: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:06:54.401 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:54 smithi063 bash[35391]: audit 2024-02-22T19:06:53.793524+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.15.63:0/1634115932' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:06:54.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:54 smithi062 bash[64101]: cluster 2024-02-22T19:06:53.464026+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v130: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:06:54.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:54 smithi062 bash[64101]: audit 2024-02-22T19:06:53.793524+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.15.63:0/1634115932' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:06:54.484 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:54 smithi062 bash[67442]: cluster 2024-02-22T19:06:53.464026+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v130: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:06:54.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:54 smithi062 bash[67442]: audit 2024-02-22T19:06:53.793524+0000 mon.b (mon.2) 11 : audit [DBG] from='client.? 172.21.15.63:0/1634115932' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:06:55.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:55 smithi063 bash[35391]: audit 2024-02-22T19:06:54.411229+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:06:55.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:55 smithi063 bash[35391]: audit 2024-02-22T19:06:54.624239+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026880\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026974\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027015\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027050\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}}, \"last_daemon_update\": \"2024-02-22T19:06:47.027141\", \"last_device_update\": \"2024-02-22T19:06:54.623572\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:06:55.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:55 smithi063 bash[35391]: audit 2024-02-22T19:06:54.627523+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026880\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026974\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027015\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027050\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}}, \"last_daemon_update\": \"2024-02-22T19:06:47.027141\", \"last_device_update\": \"2024-02-22T19:06:54.623572\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:06:55.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:55 smithi062 bash[64101]: audit 2024-02-22T19:06:54.411229+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:06:55.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:55 smithi062 bash[67442]: audit 2024-02-22T19:06:54.411229+0000 mon.a (mon.0) 390 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:06:55.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:55 smithi062 bash[64101]: audit 2024-02-22T19:06:54.624239+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026880\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026974\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027015\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027050\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}}, \"last_daemon_update\": \"2024-02-22T19:06:47.027141\", \"last_device_update\": \"2024-02-22T19:06:54.623572\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:06:55.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:55 smithi062 bash[64101]: audit 2024-02-22T19:06:54.627523+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026880\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026974\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027015\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027050\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}}, \"last_daemon_update\": \"2024-02-22T19:06:47.027141\", \"last_device_update\": \"2024-02-22T19:06:54.623572\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:06:55.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:55 smithi062 bash[67442]: audit 2024-02-22T19:06:54.624239+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026880\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026974\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027015\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027050\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}}, \"last_daemon_update\": \"2024-02-22T19:06:47.027141\", \"last_device_update\": \"2024-02-22T19:06:54.623572\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:06:55.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:55 smithi062 bash[67442]: audit 2024-02-22T19:06:54.627523+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026880\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026974\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027015\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027050\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}}, \"last_daemon_update\": \"2024-02-22T19:06:47.027141\", \"last_device_update\": \"2024-02-22T19:06:54.623572\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:06:56.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:56 smithi063 bash[35391]: cluster 2024-02-22T19:06:55.464440+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v131: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:06:56.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:56 smithi063 bash[35391]: audit 2024-02-22T19:06:56.427264+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:56.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:56 smithi062 bash[64101]: cluster 2024-02-22T19:06:55.464440+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v131: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:06:56.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:56 smithi062 bash[64101]: audit 2024-02-22T19:06:56.427264+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:56.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:56 smithi062 bash[67442]: cluster 2024-02-22T19:06:55.464440+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v131: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:06:56.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:56 smithi062 bash[67442]: audit 2024-02-22T19:06:56.427264+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:06:57.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:57 smithi063 bash[35391]: cluster 2024-02-22T19:06:57.464881+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:06:57.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:57 smithi063 bash[35391]: cluster 2024-02-22T19:06:57.515500+0000 mon.a (mon.0) 394 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-22T19:06:57.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:57 smithi063 bash[35391]: cluster 2024-02-22T19:06:57.515569+0000 mon.a (mon.0) 395 : cluster [INF] Cluster is now healthy 2024-02-22T19:06:57.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:57 smithi062 bash[64101]: cluster 2024-02-22T19:06:57.464881+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:06:57.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:57 smithi062 bash[64101]: cluster 2024-02-22T19:06:57.515500+0000 mon.a (mon.0) 394 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-22T19:06:57.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:57 smithi062 bash[64101]: cluster 2024-02-22T19:06:57.515569+0000 mon.a (mon.0) 395 : cluster [INF] Cluster is now healthy 2024-02-22T19:06:57.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:57 smithi062 bash[67442]: cluster 2024-02-22T19:06:57.464881+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:06:57.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:57 smithi062 bash[67442]: cluster 2024-02-22T19:06:57.515500+0000 mon.a (mon.0) 394 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-22T19:06:57.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:57 smithi062 bash[67442]: cluster 2024-02-22T19:06:57.515569+0000 mon.a (mon.0) 395 : cluster [INF] Cluster is now healthy 2024-02-22T19:06:59.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:59 smithi063 bash[35391]: audit 2024-02-22T19:06:59.363958+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-22T19:06:59.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:59 smithi063 bash[35391]: audit 2024-02-22T19:06:59.364744+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:59.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:06:59 smithi063 bash[35391]: audit 2024-02-22T19:06:59.365582+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2024-02-22T19:06:59.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:59 smithi062 bash[67442]: audit 2024-02-22T19:06:59.363958+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-22T19:06:59.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:59 smithi062 bash[67442]: audit 2024-02-22T19:06:59.364744+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:59.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:06:59 smithi062 bash[67442]: audit 2024-02-22T19:06:59.365582+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2024-02-22T19:06:59.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:59 smithi062 bash[64101]: audit 2024-02-22T19:06:59.363958+0000 mon.a (mon.0) 396 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-22T19:06:59.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:59 smithi062 bash[64101]: audit 2024-02-22T19:06:59.364744+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:06:59.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:06:59 smithi062 bash[64101]: audit 2024-02-22T19:06:59.365582+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2024-02-22T19:07:00.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:00 smithi063 bash[35391]: cephadm 2024-02-22T19:06:59.365315+0000 mgr.y (mgr.14140) 132 : cephadm [INF] Deploying daemon osd.6 on smithi063 2024-02-22T19:07:00.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:00 smithi063 bash[35391]: cluster 2024-02-22T19:06:59.465174+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:07:00.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:00 smithi062 bash[64101]: cephadm 2024-02-22T19:06:59.365315+0000 mgr.y (mgr.14140) 132 : cephadm [INF] Deploying daemon osd.6 on smithi063 2024-02-22T19:07:00.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:00 smithi062 bash[64101]: cluster 2024-02-22T19:06:59.465174+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:07:00.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:00 smithi062 bash[67442]: cephadm 2024-02-22T19:06:59.365315+0000 mgr.y (mgr.14140) 132 : cephadm [INF] Deploying daemon osd.6 on smithi063 2024-02-22T19:07:00.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:00 smithi062 bash[67442]: cluster 2024-02-22T19:06:59.465174+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:07:01.313 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 6 on host 'smithi063' 2024-02-22T19:07:01.553 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:01 smithi063 bash[35391]: audit 2024-02-22T19:07:01.305985+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026880\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026974\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027015\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027050\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}}, \"last_device_update\": \"2024-02-22T19:06:54.623572\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:01.553 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:01 smithi063 bash[35391]: audit 2024-02-22T19:07:01.306466+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:07:01.553 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:01 smithi063 bash[35391]: audit 2024-02-22T19:07:01.309404+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026880\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026974\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027015\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027050\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}}, \"last_device_update\": \"2024-02-22T19:06:54.623572\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:01.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:01 smithi062 bash[64101]: audit 2024-02-22T19:07:01.305985+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026880\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026974\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027015\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027050\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}}, \"last_device_update\": \"2024-02-22T19:06:54.623572\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:01.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:01 smithi062 bash[64101]: audit 2024-02-22T19:07:01.306466+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:07:01.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:01 smithi062 bash[64101]: audit 2024-02-22T19:07:01.309404+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026880\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026974\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027015\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027050\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}}, \"last_device_update\": \"2024-02-22T19:06:54.623572\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:01.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:01 smithi062 bash[67442]: audit 2024-02-22T19:07:01.305985+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026880\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026974\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027015\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027050\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}}, \"last_device_update\": \"2024-02-22T19:06:54.623572\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:01.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:01 smithi062 bash[67442]: audit 2024-02-22T19:07:01.306466+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:07:01.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:01 smithi062 bash[67442]: audit 2024-02-22T19:07:01.309404+0000 mon.a (mon.0) 401 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026880\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.026974\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027015\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:47.027050\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}}, \"last_device_update\": \"2024-02-22T19:06:54.623572\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:02.712 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:02 smithi063 bash[35391]: cluster 2024-02-22T19:07:01.465583+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:07:02.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:02 smithi062 bash[64101]: cluster 2024-02-22T19:07:01.465583+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:07:02.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:02 smithi062 bash[67442]: cluster 2024-02-22T19:07:01.465583+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:07:04.127 DEBUG:teuthology.orchestra.run.smithi063:osd.6> sudo journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.6.service 2024-02-22T19:07:04.130 INFO:tasks.cephadm:Deploying osd.7 on smithi063 with /dev/vg_nvme/lv_1... 2024-02-22T19:07:04.130 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-22T19:07:04.160 INFO:journalctl@ceph.osd.6.smithi063.stdout:-- Logs begin at Thu 2024-02-22 18:41:51 UTC. -- 2024-02-22T19:07:04.813 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:04 smithi063 bash[35391]: cluster 2024-02-22T19:07:03.466088+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:07:04.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:04 smithi062 bash[64101]: cluster 2024-02-22T19:07:03.466088+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:07:04.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:04 smithi062 bash[67442]: cluster 2024-02-22T19:07:03.466088+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:07:05.214 INFO:journalctl@ceph.osd.6.smithi063.stdout:Feb 22 19:07:04 smithi063 bash[40821]: debug 2024-02-22T19:07:04.811+0000 7fb687eeaec0 -1 Falling back to public interface 2024-02-22T19:07:05.644 INFO:journalctl@ceph.osd.6.smithi063.stdout:Feb 22 19:07:05 smithi063 bash[40821]: debug 2024-02-22T19:07:05.364+0000 7fb687eeaec0 -1 osd.6 0 log_to_monitors {default=true} 2024-02-22T19:07:05.645 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:05 smithi063 bash[35391]: audit 2024-02-22T19:07:04.784060+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783073\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783168\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783208\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783243\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783277\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}}, \"last_daemon_update\": \"2024-02-22T19:07:04.783369\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:05.645 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:05 smithi063 bash[35391]: audit 2024-02-22T19:07:04.787382+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783073\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783168\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783208\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783243\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783277\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}}, \"last_daemon_update\": \"2024-02-22T19:07:04.783369\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:05.646 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:05 smithi063 bash[35391]: audit 2024-02-22T19:07:04.788145+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:07:05.646 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:05 smithi063 bash[35391]: audit 2024-02-22T19:07:05.367930+0000 mon.b (mon.2) 12 : audit [INF] from='osd.6 [v2:172.21.15.63:6816/3276064320,v1:172.21.15.63:6817/3276064320]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-22T19:07:05.646 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:05 smithi063 bash[35391]: audit 2024-02-22T19:07:05.368287+0000 mon.a (mon.0) 405 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-22T19:07:05.646 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:05 smithi063 bash[35391]: audit 2024-02-22T19:07:05.476413+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}, {\"id\": \"f51db05f-8460-4cbb-b032-3648e3dc166c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1708628810.0414464, \"finished_at\": 1708628821.3163216}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-22T19:07:05.646 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:05 smithi063 bash[35391]: audit 2024-02-22T19:07:05.479114+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}, {\"id\": \"f51db05f-8460-4cbb-b032-3648e3dc166c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1708628810.0414464, \"finished_at\": 1708628821.3163216}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-22T19:07:05.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:05 smithi062 bash[64101]: audit 2024-02-22T19:07:04.784060+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783073\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783168\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783208\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783243\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783277\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}}, \"last_daemon_update\": \"2024-02-22T19:07:04.783369\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:05.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:05 smithi062 bash[67442]: audit 2024-02-22T19:07:04.784060+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783073\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783168\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783208\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783243\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783277\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}}, \"last_daemon_update\": \"2024-02-22T19:07:04.783369\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:05.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:05 smithi062 bash[64101]: audit 2024-02-22T19:07:04.787382+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783073\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783168\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783208\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783243\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783277\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}}, \"last_daemon_update\": \"2024-02-22T19:07:04.783369\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:05.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:05 smithi062 bash[64101]: audit 2024-02-22T19:07:04.788145+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:07:05.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:05 smithi062 bash[64101]: audit 2024-02-22T19:07:05.367930+0000 mon.b (mon.2) 12 : audit [INF] from='osd.6 [v2:172.21.15.63:6816/3276064320,v1:172.21.15.63:6817/3276064320]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-22T19:07:05.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:05 smithi062 bash[64101]: audit 2024-02-22T19:07:05.368287+0000 mon.a (mon.0) 405 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-22T19:07:05.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:05 smithi062 bash[64101]: audit 2024-02-22T19:07:05.476413+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}, {\"id\": \"f51db05f-8460-4cbb-b032-3648e3dc166c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1708628810.0414464, \"finished_at\": 1708628821.3163216}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-22T19:07:05.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:05 smithi062 bash[64101]: audit 2024-02-22T19:07:05.479114+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}, {\"id\": \"f51db05f-8460-4cbb-b032-3648e3dc166c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1708628810.0414464, \"finished_at\": 1708628821.3163216}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-22T19:07:05.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:05 smithi062 bash[67442]: audit 2024-02-22T19:07:04.787382+0000 mon.a (mon.0) 403 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783073\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783168\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783208\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783243\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783277\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}}, \"last_daemon_update\": \"2024-02-22T19:07:04.783369\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:05.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:05 smithi062 bash[67442]: audit 2024-02-22T19:07:04.788145+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:07:05.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:05 smithi062 bash[67442]: audit 2024-02-22T19:07:05.367930+0000 mon.b (mon.2) 12 : audit [INF] from='osd.6 [v2:172.21.15.63:6816/3276064320,v1:172.21.15.63:6817/3276064320]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-22T19:07:05.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:05 smithi062 bash[67442]: audit 2024-02-22T19:07:05.368287+0000 mon.a (mon.0) 405 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-22T19:07:05.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:05 smithi062 bash[67442]: audit 2024-02-22T19:07:05.476413+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}, {\"id\": \"f51db05f-8460-4cbb-b032-3648e3dc166c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1708628810.0414464, \"finished_at\": 1708628821.3163216}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-22T19:07:05.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:05 smithi062 bash[67442]: audit 2024-02-22T19:07:05.479114+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}, {\"id\": \"f51db05f-8460-4cbb-b032-3648e3dc166c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1708628810.0414464, \"finished_at\": 1708628821.3163216}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-22T19:07:06.795 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:06 smithi063 bash[35391]: cluster 2024-02-22T19:07:05.466444+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:07:06.795 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:06 smithi063 bash[35391]: audit 2024-02-22T19:07:05.790991+0000 mon.a (mon.0) 408 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-22T19:07:06.796 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:06 smithi063 bash[35391]: cluster 2024-02-22T19:07:05.791036+0000 mon.a (mon.0) 409 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2024-02-22T19:07:06.796 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:06 smithi063 bash[35391]: audit 2024-02-22T19:07:05.791210+0000 mon.a (mon.0) 410 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:07:06.796 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:06 smithi063 bash[35391]: audit 2024-02-22T19:07:05.791479+0000 mon.b (mon.2) 13 : audit [INF] from='osd.6 [v2:172.21.15.63:6816/3276064320,v1:172.21.15.63:6817/3276064320]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:07:06.796 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:06 smithi063 bash[35391]: audit 2024-02-22T19:07:05.791807+0000 mon.a (mon.0) 411 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:07:06.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:06 smithi062 bash[64101]: cluster 2024-02-22T19:07:05.466444+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:07:06.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:06 smithi062 bash[64101]: audit 2024-02-22T19:07:05.790991+0000 mon.a (mon.0) 408 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-22T19:07:06.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:06 smithi062 bash[64101]: cluster 2024-02-22T19:07:05.791036+0000 mon.a (mon.0) 409 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2024-02-22T19:07:06.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:06 smithi062 bash[64101]: audit 2024-02-22T19:07:05.791210+0000 mon.a (mon.0) 410 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:07:06.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:06 smithi062 bash[64101]: audit 2024-02-22T19:07:05.791479+0000 mon.b (mon.2) 13 : audit [INF] from='osd.6 [v2:172.21.15.63:6816/3276064320,v1:172.21.15.63:6817/3276064320]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:07:06.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:06 smithi062 bash[64101]: audit 2024-02-22T19:07:05.791807+0000 mon.a (mon.0) 411 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:07:06.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:06 smithi062 bash[67442]: cluster 2024-02-22T19:07:05.466444+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:07:06.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:06 smithi062 bash[67442]: audit 2024-02-22T19:07:05.790991+0000 mon.a (mon.0) 408 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-22T19:07:06.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:06 smithi062 bash[67442]: cluster 2024-02-22T19:07:05.791036+0000 mon.a (mon.0) 409 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2024-02-22T19:07:06.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:06 smithi062 bash[67442]: audit 2024-02-22T19:07:05.791210+0000 mon.a (mon.0) 410 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:07:06.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:06 smithi062 bash[67442]: audit 2024-02-22T19:07:05.791479+0000 mon.b (mon.2) 13 : audit [INF] from='osd.6 [v2:172.21.15.63:6816/3276064320,v1:172.21.15.63:6817/3276064320]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:07:06.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:06 smithi062 bash[67442]: audit 2024-02-22T19:07:05.791807+0000 mon.a (mon.0) 411 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:07:07.213 INFO:journalctl@ceph.osd.6.smithi063.stdout:Feb 22 19:07:06 smithi063 bash[40821]: debug 2024-02-22T19:07:06.794+0000 7fb66cc97700 -1 osd.6 0 waiting for initial osdmap 2024-02-22T19:07:07.213 INFO:journalctl@ceph.osd.6.smithi063.stdout:Feb 22 19:07:06 smithi063 bash[40821]: debug 2024-02-22T19:07:06.800+0000 7fb677eb3700 -1 osd.6 40 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-22T19:07:08.042 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-22T19:07:08.042 INFO:teuthology.orchestra.run.smithi063.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-22T19:07:08.042 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 10+0 records in 2024-02-22T19:07:08.042 INFO:teuthology.orchestra.run.smithi063.stderr:10+0 records out 2024-02-22T19:07:08.042 INFO:teuthology.orchestra.run.smithi063.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111849 s, 937 MB/s 2024-02-22T19:07:08.042 INFO:teuthology.orchestra.run.smithi063.stderr: stderr: 2024-02-22T19:07:08.042 INFO:teuthology.orchestra.run.smithi063.stderr:--> Zapping successful for: 2024-02-22T19:07:08.082 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:07 smithi063 bash[35391]: cluster 2024-02-22T19:07:06.369867+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:07:08.082 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:07 smithi063 bash[35391]: cluster 2024-02-22T19:07:06.369913+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:07:08.082 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:07 smithi063 bash[35391]: audit 2024-02-22T19:07:06.792305+0000 mon.a (mon.0) 412 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-02-22T19:07:08.082 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:07 smithi063 bash[35391]: cluster 2024-02-22T19:07:06.792363+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2024-02-22T19:07:08.082 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:07 smithi063 bash[35391]: audit 2024-02-22T19:07:06.792528+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:07:08.082 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:07 smithi063 bash[35391]: cluster 2024-02-22T19:07:07.466929+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:07:08.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:07 smithi062 bash[64101]: cluster 2024-02-22T19:07:06.369867+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:07:08.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:07 smithi062 bash[64101]: cluster 2024-02-22T19:07:06.369913+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:07:08.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:07 smithi062 bash[64101]: audit 2024-02-22T19:07:06.792305+0000 mon.a (mon.0) 412 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-02-22T19:07:08.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:07 smithi062 bash[64101]: cluster 2024-02-22T19:07:06.792363+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2024-02-22T19:07:08.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:07 smithi062 bash[64101]: audit 2024-02-22T19:07:06.792528+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:07:08.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:07 smithi062 bash[64101]: cluster 2024-02-22T19:07:07.466929+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:07:08.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:07 smithi062 bash[67442]: cluster 2024-02-22T19:07:06.369867+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:07:08.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:07 smithi062 bash[67442]: cluster 2024-02-22T19:07:06.369913+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:07:08.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:07 smithi062 bash[67442]: audit 2024-02-22T19:07:06.792305+0000 mon.a (mon.0) 412 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-02-22T19:07:08.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:07 smithi062 bash[67442]: cluster 2024-02-22T19:07:06.792363+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2024-02-22T19:07:08.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:07 smithi062 bash[67442]: audit 2024-02-22T19:07:06.792528+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:07:08.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:07 smithi062 bash[67442]: cluster 2024-02-22T19:07:07.466929+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-22T19:07:08.868 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:08 smithi063 bash[35391]: cluster 2024-02-22T19:07:07.798007+0000 mon.a (mon.0) 415 : cluster [INF] osd.6 [v2:172.21.15.63:6816/3276064320,v1:172.21.15.63:6817/3276064320] boot 2024-02-22T19:07:08.868 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:08 smithi063 bash[35391]: cluster 2024-02-22T19:07:07.798072+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2024-02-22T19:07:08.868 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:08 smithi063 bash[35391]: audit 2024-02-22T19:07:07.798251+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:07:08.879 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph orch daemon add osd smithi063:vg_nvme/lv_1 2024-02-22T19:07:09.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:08 smithi062 bash[64101]: cluster 2024-02-22T19:07:07.798007+0000 mon.a (mon.0) 415 : cluster [INF] osd.6 [v2:172.21.15.63:6816/3276064320,v1:172.21.15.63:6817/3276064320] boot 2024-02-22T19:07:09.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:08 smithi062 bash[64101]: cluster 2024-02-22T19:07:07.798072+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2024-02-22T19:07:09.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:08 smithi062 bash[64101]: audit 2024-02-22T19:07:07.798251+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:07:09.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:08 smithi062 bash[67442]: cluster 2024-02-22T19:07:07.798007+0000 mon.a (mon.0) 415 : cluster [INF] osd.6 [v2:172.21.15.63:6816/3276064320,v1:172.21.15.63:6817/3276064320] boot 2024-02-22T19:07:09.236 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:08 smithi062 bash[67442]: cluster 2024-02-22T19:07:07.798072+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2024-02-22T19:07:09.236 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:08 smithi062 bash[67442]: audit 2024-02-22T19:07:07.798251+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:07:09.236 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 22 19:07:08 smithi062 bash[71255]: debug 2024-02-22T19:07:08.800+0000 7f40fcc46700 -1 osd.1 42 build_incremental_map_msg missing incremental map 42 2024-02-22T19:07:09.236 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 22 19:07:08 smithi062 bash[71255]: debug 2024-02-22T19:07:08.953+0000 7f411d4f7700 -1 osd.1 42 build_incremental_map_msg missing incremental map 42 2024-02-22T19:07:09.236 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 22 19:07:08 smithi062 bash[71255]: debug 2024-02-22T19:07:08.953+0000 7f411c4f5700 -1 osd.1 42 build_incremental_map_msg missing incremental map 42 2024-02-22T19:07:10.063 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:09 smithi063 bash[35391]: cluster 2024-02-22T19:07:08.804482+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2024-02-22T19:07:10.063 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:09 smithi063 bash[35391]: audit 2024-02-22T19:07:09.273651+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:07:10.063 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:09 smithi063 bash[35391]: cluster 2024-02-22T19:07:09.467321+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v142: 1 pgs: 1 peering; 0 B data, 2.4 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:10.063 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:09 smithi063 bash[35391]: audit 2024-02-22T19:07:09.487015+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783073\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783168\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783208\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783243\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783277\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}}, \"last_daemon_update\": \"2024-02-22T19:07:04.783369\", \"last_device_update\": \"2024-02-22T19:07:09.486368\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:10.063 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:09 smithi063 bash[35391]: audit 2024-02-22T19:07:09.491067+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783073\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783168\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783208\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783243\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783277\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}}, \"last_daemon_update\": \"2024-02-22T19:07:04.783369\", \"last_device_update\": \"2024-02-22T19:07:09.486368\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:10.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:09 smithi062 bash[64101]: cluster 2024-02-22T19:07:08.804482+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2024-02-22T19:07:10.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:09 smithi062 bash[64101]: audit 2024-02-22T19:07:09.273651+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:07:10.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:09 smithi062 bash[64101]: cluster 2024-02-22T19:07:09.467321+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v142: 1 pgs: 1 peering; 0 B data, 2.4 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:10.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:09 smithi062 bash[67442]: cluster 2024-02-22T19:07:08.804482+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2024-02-22T19:07:10.236 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:09 smithi062 bash[67442]: audit 2024-02-22T19:07:09.273651+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:07:10.236 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:09 smithi062 bash[67442]: cluster 2024-02-22T19:07:09.467321+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v142: 1 pgs: 1 peering; 0 B data, 2.4 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:10.236 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:09 smithi062 bash[64101]: audit 2024-02-22T19:07:09.487015+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783073\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783168\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783208\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783243\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783277\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}}, \"last_daemon_update\": \"2024-02-22T19:07:04.783369\", \"last_device_update\": \"2024-02-22T19:07:09.486368\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:10.236 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:09 smithi062 bash[64101]: audit 2024-02-22T19:07:09.491067+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783073\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783168\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783208\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783243\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783277\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}}, \"last_daemon_update\": \"2024-02-22T19:07:04.783369\", \"last_device_update\": \"2024-02-22T19:07:09.486368\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:10.237 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:09 smithi062 bash[67442]: audit 2024-02-22T19:07:09.487015+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783073\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783168\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783208\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783243\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783277\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}}, \"last_daemon_update\": \"2024-02-22T19:07:04.783369\", \"last_device_update\": \"2024-02-22T19:07:09.486368\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:10.237 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:09 smithi062 bash[67442]: audit 2024-02-22T19:07:09.491067+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783073\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783168\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783208\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783243\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783277\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}}, \"last_daemon_update\": \"2024-02-22T19:07:04.783369\", \"last_device_update\": \"2024-02-22T19:07:09.486368\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:10.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:10 smithi063 bash[35391]: cluster 2024-02-22T19:07:09.806179+0000 mon.a (mon.0) 422 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-22T19:07:11.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:10 smithi062 bash[64101]: cluster 2024-02-22T19:07:09.806179+0000 mon.a (mon.0) 422 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-22T19:07:11.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:10 smithi062 bash[67442]: cluster 2024-02-22T19:07:09.806179+0000 mon.a (mon.0) 422 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-22T19:07:12.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:11 smithi063 bash[35391]: audit 2024-02-22T19:07:11.048707+0000 mgr.y (mgr.14140) 139 : audit [DBG] from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:07:12.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:11 smithi063 bash[35391]: cephadm 2024-02-22T19:07:11.049456+0000 mgr.y (mgr.14140) 140 : cephadm [INF] Applying osd on host smithi063... 2024-02-22T19:07:12.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:11 smithi063 bash[35391]: audit 2024-02-22T19:07:11.049780+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:07:12.215 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:11 smithi063 bash[35391]: audit 2024-02-22T19:07:11.050672+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:07:12.215 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:11 smithi063 bash[35391]: audit 2024-02-22T19:07:11.051932+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:07:12.215 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:11 smithi063 bash[35391]: cluster 2024-02-22T19:07:11.467725+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v143: 1 pgs: 1 peering; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:12.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:11 smithi062 bash[64101]: audit 2024-02-22T19:07:11.048707+0000 mgr.y (mgr.14140) 139 : audit [DBG] from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:07:12.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:11 smithi062 bash[64101]: cephadm 2024-02-22T19:07:11.049456+0000 mgr.y (mgr.14140) 140 : cephadm [INF] Applying osd on host smithi063... 2024-02-22T19:07:12.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:11 smithi062 bash[64101]: audit 2024-02-22T19:07:11.049780+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:07:12.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:11 smithi062 bash[64101]: audit 2024-02-22T19:07:11.050672+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:07:12.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:11 smithi062 bash[64101]: audit 2024-02-22T19:07:11.051932+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:07:12.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:11 smithi062 bash[64101]: cluster 2024-02-22T19:07:11.467725+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v143: 1 pgs: 1 peering; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:12.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:11 smithi062 bash[67442]: audit 2024-02-22T19:07:11.048707+0000 mgr.y (mgr.14140) 139 : audit [DBG] from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi063:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:07:12.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:11 smithi062 bash[67442]: cephadm 2024-02-22T19:07:11.049456+0000 mgr.y (mgr.14140) 140 : cephadm [INF] Applying osd on host smithi063... 2024-02-22T19:07:12.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:11 smithi062 bash[67442]: audit 2024-02-22T19:07:11.049780+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-22T19:07:12.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:11 smithi062 bash[67442]: audit 2024-02-22T19:07:11.050672+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:07:12.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:11 smithi062 bash[67442]: audit 2024-02-22T19:07:11.051932+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:07:12.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:11 smithi062 bash[67442]: cluster 2024-02-22T19:07:11.467725+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v143: 1 pgs: 1 peering; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:13.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:13 smithi063 bash[35391]: audit 2024-02-22T19:07:13.190763+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.15.63:0/1728896306' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70486b6f-31d1-487f-872d-f3ea7cc3d4cc"}]: dispatch 2024-02-22T19:07:13.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:13 smithi063 bash[35391]: audit 2024-02-22T19:07:13.191430+0000 mon.a (mon.0) 426 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70486b6f-31d1-487f-872d-f3ea7cc3d4cc"}]: dispatch 2024-02-22T19:07:13.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:13 smithi063 bash[35391]: audit 2024-02-22T19:07:13.198959+0000 mon.a (mon.0) 427 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70486b6f-31d1-487f-872d-f3ea7cc3d4cc"}]': finished 2024-02-22T19:07:13.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:13 smithi063 bash[35391]: cluster 2024-02-22T19:07:13.199008+0000 mon.a (mon.0) 428 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2024-02-22T19:07:13.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:13 smithi063 bash[35391]: audit 2024-02-22T19:07:13.199175+0000 mon.a (mon.0) 429 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:07:13.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:13 smithi062 bash[67442]: audit 2024-02-22T19:07:13.190763+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.15.63:0/1728896306' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70486b6f-31d1-487f-872d-f3ea7cc3d4cc"}]: dispatch 2024-02-22T19:07:13.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:13 smithi062 bash[67442]: audit 2024-02-22T19:07:13.191430+0000 mon.a (mon.0) 426 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70486b6f-31d1-487f-872d-f3ea7cc3d4cc"}]: dispatch 2024-02-22T19:07:13.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:13 smithi062 bash[67442]: audit 2024-02-22T19:07:13.198959+0000 mon.a (mon.0) 427 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70486b6f-31d1-487f-872d-f3ea7cc3d4cc"}]': finished 2024-02-22T19:07:13.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:13 smithi062 bash[67442]: cluster 2024-02-22T19:07:13.199008+0000 mon.a (mon.0) 428 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2024-02-22T19:07:13.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:13 smithi062 bash[67442]: audit 2024-02-22T19:07:13.199175+0000 mon.a (mon.0) 429 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:07:13.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:13 smithi062 bash[64101]: audit 2024-02-22T19:07:13.190763+0000 mon.b (mon.2) 14 : audit [INF] from='client.? 172.21.15.63:0/1728896306' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70486b6f-31d1-487f-872d-f3ea7cc3d4cc"}]: dispatch 2024-02-22T19:07:13.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:13 smithi062 bash[64101]: audit 2024-02-22T19:07:13.191430+0000 mon.a (mon.0) 426 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "70486b6f-31d1-487f-872d-f3ea7cc3d4cc"}]: dispatch 2024-02-22T19:07:13.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:13 smithi062 bash[64101]: audit 2024-02-22T19:07:13.198959+0000 mon.a (mon.0) 427 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "70486b6f-31d1-487f-872d-f3ea7cc3d4cc"}]': finished 2024-02-22T19:07:13.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:13 smithi062 bash[64101]: cluster 2024-02-22T19:07:13.199008+0000 mon.a (mon.0) 428 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2024-02-22T19:07:13.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:13 smithi062 bash[64101]: audit 2024-02-22T19:07:13.199175+0000 mon.a (mon.0) 429 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:07:14.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:14 smithi063 bash[35391]: cluster 2024-02-22T19:07:13.468186+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v145: 1 pgs: 1 peering; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:14.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:14 smithi063 bash[35391]: audit 2024-02-22T19:07:13.969677+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.15.63:0/4148421521' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:07:14.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:14 smithi062 bash[64101]: cluster 2024-02-22T19:07:13.468186+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v145: 1 pgs: 1 peering; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:14.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:14 smithi062 bash[64101]: audit 2024-02-22T19:07:13.969677+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.15.63:0/4148421521' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:07:14.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:14 smithi062 bash[67442]: cluster 2024-02-22T19:07:13.468186+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v145: 1 pgs: 1 peering; 0 B data, 2.6 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:14.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:14 smithi062 bash[67442]: audit 2024-02-22T19:07:13.969677+0000 mon.b (mon.2) 15 : audit [DBG] from='client.? 172.21.15.63:0/4148421521' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-22T19:07:16.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:16 smithi063 bash[35391]: cluster 2024-02-22T19:07:15.468773+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:16.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:16 smithi062 bash[64101]: cluster 2024-02-22T19:07:15.468773+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:16.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:16 smithi062 bash[67442]: cluster 2024-02-22T19:07:15.468773+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:17.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:17 smithi063 bash[35391]: cluster 2024-02-22T19:07:16.441125+0000 mon.a (mon.0) 430 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-22T19:07:17.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:17 smithi063 bash[35391]: cluster 2024-02-22T19:07:16.441210+0000 mon.a (mon.0) 431 : cluster [INF] Cluster is now healthy 2024-02-22T19:07:17.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:17 smithi063 bash[35391]: audit 2024-02-22T19:07:16.508601+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:07:17.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:17 smithi062 bash[64101]: cluster 2024-02-22T19:07:16.441125+0000 mon.a (mon.0) 430 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-22T19:07:17.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:17 smithi062 bash[64101]: cluster 2024-02-22T19:07:16.441210+0000 mon.a (mon.0) 431 : cluster [INF] Cluster is now healthy 2024-02-22T19:07:17.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:17 smithi062 bash[64101]: audit 2024-02-22T19:07:16.508601+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:07:17.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:17 smithi062 bash[67442]: cluster 2024-02-22T19:07:16.441125+0000 mon.a (mon.0) 430 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-22T19:07:17.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:17 smithi062 bash[67442]: cluster 2024-02-22T19:07:16.441210+0000 mon.a (mon.0) 431 : cluster [INF] Cluster is now healthy 2024-02-22T19:07:17.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:17 smithi062 bash[67442]: audit 2024-02-22T19:07:16.508601+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:07:18.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:18 smithi063 bash[35391]: cluster 2024-02-22T19:07:17.469151+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:18.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:18 smithi062 bash[64101]: cluster 2024-02-22T19:07:17.469151+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:18.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:18 smithi062 bash[67442]: cluster 2024-02-22T19:07:17.469151+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:19.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:19 smithi063 bash[35391]: audit 2024-02-22T19:07:19.060044+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-22T19:07:19.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:19 smithi063 bash[35391]: audit 2024-02-22T19:07:19.060850+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:07:19.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:19 smithi063 bash[35391]: audit 2024-02-22T19:07:19.061722+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2024-02-22T19:07:19.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:19 smithi062 bash[64101]: audit 2024-02-22T19:07:19.060044+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-22T19:07:19.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:19 smithi062 bash[64101]: audit 2024-02-22T19:07:19.060850+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:07:19.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:19 smithi062 bash[64101]: audit 2024-02-22T19:07:19.061722+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2024-02-22T19:07:19.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:19 smithi062 bash[67442]: audit 2024-02-22T19:07:19.060044+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-22T19:07:19.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:19 smithi062 bash[67442]: audit 2024-02-22T19:07:19.060850+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:07:19.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:19 smithi062 bash[67442]: audit 2024-02-22T19:07:19.061722+0000 mon.a (mon.0) 435 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2024-02-22T19:07:20.638 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:20 smithi063 bash[35391]: cephadm 2024-02-22T19:07:19.061419+0000 mgr.y (mgr.14140) 145 : cephadm [INF] Deploying daemon osd.7 on smithi063 2024-02-22T19:07:20.638 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:20 smithi063 bash[35391]: cluster 2024-02-22T19:07:19.469499+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:20.710 INFO:teuthology.orchestra.run.smithi063.stdout:Created osd(s) 7 on host 'smithi063' 2024-02-22T19:07:20.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:20 smithi062 bash[64101]: cephadm 2024-02-22T19:07:19.061419+0000 mgr.y (mgr.14140) 145 : cephadm [INF] Deploying daemon osd.7 on smithi063 2024-02-22T19:07:20.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:20 smithi062 bash[64101]: cluster 2024-02-22T19:07:19.469499+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:20.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:20 smithi062 bash[67442]: cephadm 2024-02-22T19:07:19.061419+0000 mgr.y (mgr.14140) 145 : cephadm [INF] Deploying daemon osd.7 on smithi063 2024-02-22T19:07:20.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:20 smithi062 bash[67442]: cluster 2024-02-22T19:07:19.469499+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 2.7 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:21.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:21 smithi063 bash[35391]: audit 2024-02-22T19:07:20.701115+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783073\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783168\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783208\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783243\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783277\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}}, \"last_device_update\": \"2024-02-22T19:07:09.486368\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:21.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:21 smithi063 bash[35391]: audit 2024-02-22T19:07:20.701576+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:07:21.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:21 smithi063 bash[35391]: audit 2024-02-22T19:07:20.707409+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783073\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783168\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783208\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783243\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783277\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}}, \"last_device_update\": \"2024-02-22T19:07:09.486368\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:21.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:21 smithi062 bash[64101]: audit 2024-02-22T19:07:20.701115+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783073\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783168\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783208\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783243\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783277\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}}, \"last_device_update\": \"2024-02-22T19:07:09.486368\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:21.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:21 smithi062 bash[64101]: audit 2024-02-22T19:07:20.701576+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:07:21.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:21 smithi062 bash[64101]: audit 2024-02-22T19:07:20.707409+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783073\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783168\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783208\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783243\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783277\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}}, \"last_device_update\": \"2024-02-22T19:07:09.486368\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:21.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:21 smithi062 bash[67442]: audit 2024-02-22T19:07:20.701115+0000 mon.a (mon.0) 436 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783073\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783168\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783208\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783243\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783277\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}}, \"last_device_update\": \"2024-02-22T19:07:09.486368\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:21.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:21 smithi062 bash[67442]: audit 2024-02-22T19:07:20.701576+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:07:21.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:21 smithi062 bash[67442]: audit 2024-02-22T19:07:20.707409+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783073\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783168\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783208\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783243\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:04.783277\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}}, \"last_device_update\": \"2024-02-22T19:07:09.486368\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:22.626 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:22 smithi063 bash[35391]: cluster 2024-02-22T19:07:21.469955+0000 mgr.y (mgr.14140) 147 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:22.641 DEBUG:teuthology.orchestra.run.smithi063:osd.7> sudo journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.7.service 2024-02-22T19:07:22.644 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-02-22T19:07:22.644 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph osd stat -f json 2024-02-22T19:07:22.677 INFO:journalctl@ceph.osd.7.smithi063.stdout:-- Logs begin at Thu 2024-02-22 18:41:51 UTC. -- 2024-02-22T19:07:22.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:22 smithi062 bash[64101]: cluster 2024-02-22T19:07:21.469955+0000 mgr.y (mgr.14140) 147 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:22.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:22 smithi062 bash[67442]: cluster 2024-02-22T19:07:21.469955+0000 mgr.y (mgr.14140) 147 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:24.330 INFO:journalctl@ceph.osd.7.smithi063.stdout:Feb 22 19:07:24 smithi063 bash[42392]: debug 2024-02-22T19:07:24.004+0000 7f23bc588ec0 -1 Falling back to public interface 2024-02-22T19:07:24.493 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T19:07:24.698 INFO:journalctl@ceph.osd.7.smithi063.stdout:Feb 22 19:07:24 smithi063 bash[42392]: debug 2024-02-22T19:07:24.560+0000 7f23bc588ec0 -1 osd.7 0 log_to_monitors {default=true} 2024-02-22T19:07:24.699 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:24 smithi063 bash[35391]: cluster 2024-02-22T19:07:23.470389+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:24.699 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:24 smithi063 bash[35391]: audit 2024-02-22T19:07:23.699360+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698451\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698530\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698565\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698596\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698627\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698679\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}}, \"last_daemon_update\": \"2024-02-22T19:07:23.698756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:24.699 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:24 smithi063 bash[35391]: audit 2024-02-22T19:07:23.704096+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698451\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698530\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698565\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698596\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698627\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698679\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}}, \"last_daemon_update\": \"2024-02-22T19:07:23.698756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:24.699 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:24 smithi063 bash[35391]: audit 2024-02-22T19:07:23.704667+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:07:24.699 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:24 smithi063 bash[35391]: audit 2024-02-22T19:07:24.492813+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.15.62:0/3902180412' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-22T19:07:24.939 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:24 smithi062 bash[64101]: cluster 2024-02-22T19:07:23.470389+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:24.939 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:24 smithi062 bash[67442]: cluster 2024-02-22T19:07:23.470389+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:24.940 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:24 smithi062 bash[64101]: audit 2024-02-22T19:07:23.699360+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698451\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698530\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698565\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698596\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698627\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698679\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}}, \"last_daemon_update\": \"2024-02-22T19:07:23.698756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:24.940 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:24 smithi062 bash[64101]: audit 2024-02-22T19:07:23.704096+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698451\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698530\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698565\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698596\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698627\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698679\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}}, \"last_daemon_update\": \"2024-02-22T19:07:23.698756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:24.940 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:24 smithi062 bash[64101]: audit 2024-02-22T19:07:23.704667+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:07:24.940 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:24 smithi062 bash[64101]: audit 2024-02-22T19:07:24.492813+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.15.62:0/3902180412' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-22T19:07:24.941 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:24 smithi062 bash[67442]: audit 2024-02-22T19:07:23.699360+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698451\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698530\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698565\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698596\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698627\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698679\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}}, \"last_daemon_update\": \"2024-02-22T19:07:23.698756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:24.941 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:24 smithi062 bash[67442]: audit 2024-02-22T19:07:23.704096+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698451\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698530\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698565\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698596\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698627\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698679\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}}, \"last_daemon_update\": \"2024-02-22T19:07:23.698756\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:24.941 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:24 smithi062 bash[67442]: audit 2024-02-22T19:07:23.704667+0000 mon.a (mon.0) 441 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-22T19:07:24.941 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:24 smithi062 bash[67442]: audit 2024-02-22T19:07:24.492813+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.15.62:0/3902180412' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-22T19:07:25.121 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":43,"num_osds":8,"num_up_osds":7,"osd_up_since":1708628827,"num_in_osds":7,"osd_in_since":1708628827,"num_remapped_pgs":0} 2024-02-22T19:07:25.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:25 smithi063 bash[35391]: audit 2024-02-22T19:07:24.564294+0000 mon.b (mon.2) 16 : audit [INF] from='osd.7 [v2:172.21.15.63:6824/3078928935,v1:172.21.15.63:6825/3078928935]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-22T19:07:25.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:25 smithi063 bash[35391]: audit 2024-02-22T19:07:24.564646+0000 mon.a (mon.0) 442 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-22T19:07:25.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:25 smithi063 bash[35391]: audit 2024-02-22T19:07:25.480558+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}, {\"id\": \"f51db05f-8460-4cbb-b032-3648e3dc166c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1708628810.0414464, \"finished_at\": 1708628821.3163216}, {\"id\": \"44ddf4df-f918-460c-b297-b0537537ee61\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708628827.7974782, \"finished_at\": 1708628840.7128322}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-22T19:07:25.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:25 smithi063 bash[35391]: audit 2024-02-22T19:07:25.486201+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}, {\"id\": \"f51db05f-8460-4cbb-b032-3648e3dc166c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1708628810.0414464, \"finished_at\": 1708628821.3163216}, {\"id\": \"44ddf4df-f918-460c-b297-b0537537ee61\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708628827.7974782, \"finished_at\": 1708628840.7128322}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-22T19:07:25.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:25 smithi062 bash[64101]: audit 2024-02-22T19:07:24.564294+0000 mon.b (mon.2) 16 : audit [INF] from='osd.7 [v2:172.21.15.63:6824/3078928935,v1:172.21.15.63:6825/3078928935]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-22T19:07:25.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:25 smithi062 bash[64101]: audit 2024-02-22T19:07:24.564646+0000 mon.a (mon.0) 442 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-22T19:07:25.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:25 smithi062 bash[64101]: audit 2024-02-22T19:07:25.480558+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}, {\"id\": \"f51db05f-8460-4cbb-b032-3648e3dc166c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1708628810.0414464, \"finished_at\": 1708628821.3163216}, {\"id\": \"44ddf4df-f918-460c-b297-b0537537ee61\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708628827.7974782, \"finished_at\": 1708628840.7128322}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-22T19:07:25.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:25 smithi062 bash[64101]: audit 2024-02-22T19:07:25.486201+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}, {\"id\": \"f51db05f-8460-4cbb-b032-3648e3dc166c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1708628810.0414464, \"finished_at\": 1708628821.3163216}, {\"id\": \"44ddf4df-f918-460c-b297-b0537537ee61\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708628827.7974782, \"finished_at\": 1708628840.7128322}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-22T19:07:25.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:25 smithi062 bash[67442]: audit 2024-02-22T19:07:24.564294+0000 mon.b (mon.2) 16 : audit [INF] from='osd.7 [v2:172.21.15.63:6824/3078928935,v1:172.21.15.63:6825/3078928935]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-22T19:07:25.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:25 smithi062 bash[67442]: audit 2024-02-22T19:07:24.564646+0000 mon.a (mon.0) 442 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-22T19:07:25.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:25 smithi062 bash[67442]: audit 2024-02-22T19:07:25.480558+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}, {\"id\": \"f51db05f-8460-4cbb-b032-3648e3dc166c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1708628810.0414464, \"finished_at\": 1708628821.3163216}, {\"id\": \"44ddf4df-f918-460c-b297-b0537537ee61\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708628827.7974782, \"finished_at\": 1708628840.7128322}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-22T19:07:25.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:25 smithi062 bash[67442]: audit 2024-02-22T19:07:25.486201+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}, {\"id\": \"f51db05f-8460-4cbb-b032-3648e3dc166c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1708628810.0414464, \"finished_at\": 1708628821.3163216}, {\"id\": \"44ddf4df-f918-460c-b297-b0537537ee61\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708628827.7974782, \"finished_at\": 1708628840.7128322}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-22T19:07:26.123 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph osd stat -f json 2024-02-22T19:07:26.713 INFO:journalctl@ceph.osd.7.smithi063.stdout:Feb 22 19:07:26 smithi063 bash[42392]: debug 2024-02-22T19:07:26.545+0000 7f23a1335700 -1 osd.7 0 waiting for initial osdmap 2024-02-22T19:07:26.714 INFO:journalctl@ceph.osd.7.smithi063.stdout:Feb 22 19:07:26 smithi063 bash[42392]: debug 2024-02-22T19:07:26.555+0000 7f23ac551700 -1 osd.7 45 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-22T19:07:26.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:26 smithi063 bash[35391]: cluster 2024-02-22T19:07:25.470726+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:26.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:26 smithi063 bash[35391]: audit 2024-02-22T19:07:25.542394+0000 mon.a (mon.0) 445 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-22T19:07:26.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:26 smithi063 bash[35391]: cluster 2024-02-22T19:07:25.542462+0000 mon.a (mon.0) 446 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2024-02-22T19:07:26.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:26 smithi063 bash[35391]: audit 2024-02-22T19:07:25.542681+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:07:26.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:26 smithi063 bash[35391]: audit 2024-02-22T19:07:25.542875+0000 mon.b (mon.2) 17 : audit [INF] from='osd.7 [v2:172.21.15.63:6824/3078928935,v1:172.21.15.63:6825/3078928935]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:07:26.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:26 smithi063 bash[35391]: audit 2024-02-22T19:07:25.543156+0000 mon.a (mon.0) 448 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:07:26.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:26 smithi062 bash[67442]: cluster 2024-02-22T19:07:25.470726+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:26.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:26 smithi062 bash[67442]: audit 2024-02-22T19:07:25.542394+0000 mon.a (mon.0) 445 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-22T19:07:26.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:26 smithi062 bash[67442]: cluster 2024-02-22T19:07:25.542462+0000 mon.a (mon.0) 446 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2024-02-22T19:07:26.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:26 smithi062 bash[67442]: audit 2024-02-22T19:07:25.542681+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:07:26.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:26 smithi062 bash[67442]: audit 2024-02-22T19:07:25.542875+0000 mon.b (mon.2) 17 : audit [INF] from='osd.7 [v2:172.21.15.63:6824/3078928935,v1:172.21.15.63:6825/3078928935]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:07:26.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:26 smithi062 bash[67442]: audit 2024-02-22T19:07:25.543156+0000 mon.a (mon.0) 448 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:07:26.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:26 smithi062 bash[64101]: cluster 2024-02-22T19:07:25.470726+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:26.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:26 smithi062 bash[64101]: audit 2024-02-22T19:07:25.542394+0000 mon.a (mon.0) 445 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-22T19:07:26.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:26 smithi062 bash[64101]: cluster 2024-02-22T19:07:25.542462+0000 mon.a (mon.0) 446 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2024-02-22T19:07:26.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:26 smithi062 bash[64101]: audit 2024-02-22T19:07:25.542681+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:07:26.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:26 smithi062 bash[64101]: audit 2024-02-22T19:07:25.542875+0000 mon.b (mon.2) 17 : audit [INF] from='osd.7 [v2:172.21.15.63:6824/3078928935,v1:172.21.15.63:6825/3078928935]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:07:26.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:26 smithi062 bash[64101]: audit 2024-02-22T19:07:25.543156+0000 mon.a (mon.0) 448 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]: dispatch 2024-02-22T19:07:27.621 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:27 smithi062 bash[64101]: cluster 2024-02-22T19:07:25.606818+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:07:27.621 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:27 smithi062 bash[64101]: cluster 2024-02-22T19:07:25.606913+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:07:27.621 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:27 smithi062 bash[64101]: audit 2024-02-22T19:07:26.543589+0000 mon.a (mon.0) 449 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-02-22T19:07:27.621 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:27 smithi062 bash[64101]: cluster 2024-02-22T19:07:26.543634+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2024-02-22T19:07:27.622 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:27 smithi062 bash[64101]: audit 2024-02-22T19:07:26.544111+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:07:27.622 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:27 smithi062 bash[64101]: audit 2024-02-22T19:07:26.573479+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:07:27.622 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:27 smithi062 bash[67442]: cluster 2024-02-22T19:07:25.606818+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:07:27.622 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:27 smithi062 bash[67442]: cluster 2024-02-22T19:07:25.606913+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:07:27.622 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:27 smithi062 bash[67442]: audit 2024-02-22T19:07:26.543589+0000 mon.a (mon.0) 449 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-02-22T19:07:27.622 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:27 smithi062 bash[67442]: cluster 2024-02-22T19:07:26.543634+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2024-02-22T19:07:27.622 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:27 smithi062 bash[67442]: audit 2024-02-22T19:07:26.544111+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:07:27.622 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:27 smithi062 bash[67442]: audit 2024-02-22T19:07:26.573479+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:07:27.623 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:27 smithi062 bash[64101]: audit 2024-02-22T19:07:26.786067+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698451\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698530\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698565\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698596\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698627\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698679\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}}, \"last_daemon_update\": \"2024-02-22T19:07:23.698756\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:27.623 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:27 smithi062 bash[64101]: audit 2024-02-22T19:07:26.790987+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698451\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698530\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698565\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698596\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698627\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698679\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}}, \"last_daemon_update\": \"2024-02-22T19:07:23.698756\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:27.623 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:27 smithi062 bash[67442]: audit 2024-02-22T19:07:26.786067+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698451\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698530\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698565\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698596\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698627\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698679\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}}, \"last_daemon_update\": \"2024-02-22T19:07:23.698756\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:27.623 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:27 smithi062 bash[67442]: audit 2024-02-22T19:07:26.790987+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698451\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698530\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698565\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698596\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698627\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698679\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}}, \"last_daemon_update\": \"2024-02-22T19:07:23.698756\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:27.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:27 smithi063 bash[35391]: cluster 2024-02-22T19:07:25.606818+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-22T19:07:27.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:27 smithi063 bash[35391]: cluster 2024-02-22T19:07:25.606913+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-22T19:07:27.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:27 smithi063 bash[35391]: audit 2024-02-22T19:07:26.543589+0000 mon.a (mon.0) 449 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi063", "root=default"]}]': finished 2024-02-22T19:07:27.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:27 smithi063 bash[35391]: cluster 2024-02-22T19:07:26.543634+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2024-02-22T19:07:27.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:27 smithi063 bash[35391]: audit 2024-02-22T19:07:26.544111+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:07:27.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:27 smithi063 bash[35391]: audit 2024-02-22T19:07:26.573479+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:07:27.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:27 smithi063 bash[35391]: audit 2024-02-22T19:07:26.786067+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698451\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698530\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698565\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698596\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698627\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698679\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}}, \"last_daemon_update\": \"2024-02-22T19:07:23.698756\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:27.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:27 smithi063 bash[35391]: audit 2024-02-22T19:07:26.790987+0000 mon.a (mon.0) 454 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698451\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698530\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698565\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698596\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698627\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698679\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}}, \"last_daemon_update\": \"2024-02-22T19:07:23.698756\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:27.980 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T19:07:28.634 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":46,"num_osds":8,"num_up_osds":8,"osd_up_since":1708628847,"num_in_osds":8,"osd_in_since":1708628847,"num_remapped_pgs":0} 2024-02-22T19:07:28.634 INFO:tasks.cephadm:Adding prometheus.a on smithi063 2024-02-22T19:07:28.635 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph orch apply prometheus '1;smithi063=a' 2024-02-22T19:07:28.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:28 smithi062 bash[67442]: cluster 2024-02-22T19:07:27.471014+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:28.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:28 smithi062 bash[67442]: cluster 2024-02-22T19:07:27.544849+0000 mon.a (mon.0) 455 : cluster [INF] osd.7 [v2:172.21.15.63:6824/3078928935,v1:172.21.15.63:6825/3078928935] boot 2024-02-22T19:07:28.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:28 smithi062 bash[67442]: cluster 2024-02-22T19:07:27.544888+0000 mon.a (mon.0) 456 : cluster [DBG] osdmap e46: 8 total, 8 up, 8 in 2024-02-22T19:07:28.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:28 smithi062 bash[67442]: audit 2024-02-22T19:07:27.545034+0000 mon.a (mon.0) 457 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:07:28.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:28 smithi062 bash[67442]: audit 2024-02-22T19:07:27.979516+0000 mon.c (mon.1) 9 : audit [DBG] from='client.? 172.21.15.62:0/1378116496' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-22T19:07:28.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:28 smithi062 bash[64101]: cluster 2024-02-22T19:07:27.471014+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:28.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:28 smithi062 bash[64101]: cluster 2024-02-22T19:07:27.544849+0000 mon.a (mon.0) 455 : cluster [INF] osd.7 [v2:172.21.15.63:6824/3078928935,v1:172.21.15.63:6825/3078928935] boot 2024-02-22T19:07:28.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:28 smithi062 bash[64101]: cluster 2024-02-22T19:07:27.544888+0000 mon.a (mon.0) 456 : cluster [DBG] osdmap e46: 8 total, 8 up, 8 in 2024-02-22T19:07:28.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:28 smithi062 bash[64101]: audit 2024-02-22T19:07:27.545034+0000 mon.a (mon.0) 457 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:07:28.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:28 smithi062 bash[64101]: audit 2024-02-22T19:07:27.979516+0000 mon.c (mon.1) 9 : audit [DBG] from='client.? 172.21.15.62:0/1378116496' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-22T19:07:28.963 INFO:journalctl@ceph.osd.6.smithi063.stdout:Feb 22 19:07:28 smithi063 bash[40821]: debug 2024-02-22T19:07:28.553+0000 7fb661e87700 -1 osd.6 47 build_incremental_map_msg missing incremental map 47 2024-02-22T19:07:28.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:28 smithi063 bash[35391]: cluster 2024-02-22T19:07:27.471014+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 619 GiB / 626 GiB avail 2024-02-22T19:07:28.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:28 smithi063 bash[35391]: cluster 2024-02-22T19:07:27.544849+0000 mon.a (mon.0) 455 : cluster [INF] osd.7 [v2:172.21.15.63:6824/3078928935,v1:172.21.15.63:6825/3078928935] boot 2024-02-22T19:07:28.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:28 smithi063 bash[35391]: cluster 2024-02-22T19:07:27.544888+0000 mon.a (mon.0) 456 : cluster [DBG] osdmap e46: 8 total, 8 up, 8 in 2024-02-22T19:07:28.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:28 smithi063 bash[35391]: audit 2024-02-22T19:07:27.545034+0000 mon.a (mon.0) 457 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:07:28.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:28 smithi063 bash[35391]: audit 2024-02-22T19:07:27.979516+0000 mon.c (mon.1) 9 : audit [DBG] from='client.? 172.21.15.62:0/1378116496' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-22T19:07:29.868 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:29 smithi063 bash[35391]: cluster 2024-02-22T19:07:28.553509+0000 mon.a (mon.0) 458 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2024-02-22T19:07:29.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:29 smithi062 bash[64101]: cluster 2024-02-22T19:07:28.553509+0000 mon.a (mon.0) 458 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2024-02-22T19:07:29.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:29 smithi062 bash[67442]: cluster 2024-02-22T19:07:28.553509+0000 mon.a (mon.0) 458 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2024-02-22T19:07:30.529 INFO:teuthology.orchestra.run.smithi063.stdout:Scheduled prometheus update... 2024-02-22T19:07:30.944 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:30 smithi063 bash[35391]: cluster 2024-02-22T19:07:29.471473+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 3.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:30.944 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:30 smithi063 bash[35391]: audit 2024-02-22T19:07:30.520866+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-02-22T19:07:30.520507\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi063\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2024-02-22T19:07:30.944 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:30 smithi063 bash[35391]: audit 2024-02-22T19:07:30.524119+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-02-22T19:07:30.520507\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi063\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2024-02-22T19:07:30.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:30 smithi062 bash[64101]: cluster 2024-02-22T19:07:29.471473+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 3.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:30.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:30 smithi062 bash[64101]: audit 2024-02-22T19:07:30.520866+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-02-22T19:07:30.520507\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi063\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2024-02-22T19:07:30.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:30 smithi062 bash[64101]: audit 2024-02-22T19:07:30.524119+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-02-22T19:07:30.520507\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi063\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2024-02-22T19:07:30.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:30 smithi062 bash[67442]: cluster 2024-02-22T19:07:29.471473+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 3.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:30.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:30 smithi062 bash[67442]: audit 2024-02-22T19:07:30.520866+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-02-22T19:07:30.520507\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi063\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2024-02-22T19:07:30.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:30 smithi062 bash[67442]: audit 2024-02-22T19:07:30.524119+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-02-22T19:07:30.520507\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi063\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2024-02-22T19:07:31.145 DEBUG:teuthology.orchestra.run.smithi063:prometheus.a> sudo journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@prometheus.a.service 2024-02-22T19:07:31.147 INFO:tasks.cephadm:Adding node-exporter.a on smithi062 2024-02-22T19:07:31.147 INFO:tasks.cephadm:Adding node-exporter.b on smithi063 2024-02-22T19:07:31.147 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph orch apply node-exporter '2;smithi062=a;smithi063=b' 2024-02-22T19:07:31.179 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:-- Logs begin at Thu 2024-02-22 18:41:51 UTC. -- 2024-02-22T19:07:31.758 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:31 smithi063 bash[35391]: audit 2024-02-22T19:07:30.519927+0000 mgr.y (mgr.14140) 152 : audit [DBG] from='client.34289 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi063=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:07:31.758 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:31 smithi063 bash[35391]: cephadm 2024-02-22T19:07:30.520495+0000 mgr.y (mgr.14140) 153 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi063=a 2024-02-22T19:07:31.758 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:31 smithi063 bash[35391]: cephadm 2024-02-22T19:07:30.527729+0000 mgr.y (mgr.14140) 154 : cephadm [INF] Deploying daemon prometheus.a on smithi063 2024-02-22T19:07:31.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:31 smithi062 bash[64101]: audit 2024-02-22T19:07:30.519927+0000 mgr.y (mgr.14140) 152 : audit [DBG] from='client.34289 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi063=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:07:31.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:31 smithi062 bash[64101]: cephadm 2024-02-22T19:07:30.520495+0000 mgr.y (mgr.14140) 153 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi063=a 2024-02-22T19:07:31.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:31 smithi062 bash[64101]: cephadm 2024-02-22T19:07:30.527729+0000 mgr.y (mgr.14140) 154 : cephadm [INF] Deploying daemon prometheus.a on smithi063 2024-02-22T19:07:31.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:31 smithi062 bash[67442]: audit 2024-02-22T19:07:30.519927+0000 mgr.y (mgr.14140) 152 : audit [DBG] from='client.34289 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi063=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:07:31.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:31 smithi062 bash[67442]: cephadm 2024-02-22T19:07:30.520495+0000 mgr.y (mgr.14140) 153 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi063=a 2024-02-22T19:07:31.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:31 smithi062 bash[67442]: cephadm 2024-02-22T19:07:30.527729+0000 mgr.y (mgr.14140) 154 : cephadm [INF] Deploying daemon prometheus.a on smithi063 2024-02-22T19:07:32.595 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:32 smithi063 bash[35391]: cluster 2024-02-22T19:07:31.471881+0000 mgr.y (mgr.14140) 155 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:32.978 INFO:teuthology.orchestra.run.smithi063.stdout:Scheduled node-exporter update... 2024-02-22T19:07:32.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:32 smithi062 bash[64101]: cluster 2024-02-22T19:07:31.471881+0000 mgr.y (mgr.14140) 155 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:32.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:32 smithi062 bash[67442]: cluster 2024-02-22T19:07:31.471881+0000 mgr.y (mgr.14140) 155 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:33.673 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:33 smithi063 bash[35391]: audit 2024-02-22T19:07:32.972493+0000 mgr.y (mgr.14140) 156 : audit [DBG] from='client.34295 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi062=a;smithi063=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:07:33.673 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:33 smithi063 bash[35391]: cephadm 2024-02-22T19:07:32.973081+0000 mgr.y (mgr.14140) 157 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi062=a,smithi063=b 2024-02-22T19:07:33.673 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:33 smithi063 bash[35391]: audit 2024-02-22T19:07:32.973439+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-02-22T19:07:32.973095\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi062\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi063\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2024-02-22T19:07:33.673 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:33 smithi063 bash[35391]: audit 2024-02-22T19:07:32.976587+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-02-22T19:07:32.973095\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi062\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi063\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2024-02-22T19:07:33.673 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:33 smithi063 bash[35391]: cluster 2024-02-22T19:07:33.472350+0000 mgr.y (mgr.14140) 158 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:33.684 DEBUG:teuthology.orchestra.run.smithi062:node-exporter.a> sudo journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@node-exporter.a.service 2024-02-22T19:07:33.687 DEBUG:teuthology.orchestra.run.smithi063:node-exporter.b> sudo journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@node-exporter.b.service 2024-02-22T19:07:33.689 INFO:tasks.cephadm:Adding alertmanager.a on smithi062 2024-02-22T19:07:33.689 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph orch apply alertmanager '1;smithi062=a' 2024-02-22T19:07:33.720 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:-- Logs begin at Thu 2024-02-22 18:41:51 UTC. -- 2024-02-22T19:07:33.724 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:-- Logs begin at Thu 2024-02-22 18:41:31 UTC. -- 2024-02-22T19:07:33.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:33 smithi062 bash[64101]: audit 2024-02-22T19:07:32.972493+0000 mgr.y (mgr.14140) 156 : audit [DBG] from='client.34295 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi062=a;smithi063=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:07:33.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:33 smithi062 bash[64101]: cephadm 2024-02-22T19:07:32.973081+0000 mgr.y (mgr.14140) 157 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi062=a,smithi063=b 2024-02-22T19:07:33.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:33 smithi062 bash[64101]: audit 2024-02-22T19:07:32.973439+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-02-22T19:07:32.973095\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi062\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi063\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2024-02-22T19:07:33.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:33 smithi062 bash[64101]: audit 2024-02-22T19:07:32.976587+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-02-22T19:07:32.973095\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi062\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi063\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2024-02-22T19:07:33.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:33 smithi062 bash[64101]: cluster 2024-02-22T19:07:33.472350+0000 mgr.y (mgr.14140) 158 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:33.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:33 smithi062 bash[67442]: audit 2024-02-22T19:07:32.972493+0000 mgr.y (mgr.14140) 156 : audit [DBG] from='client.34295 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi062=a;smithi063=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:07:33.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:33 smithi062 bash[67442]: cephadm 2024-02-22T19:07:32.973081+0000 mgr.y (mgr.14140) 157 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi062=a,smithi063=b 2024-02-22T19:07:33.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:33 smithi062 bash[67442]: audit 2024-02-22T19:07:32.973439+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-02-22T19:07:32.973095\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi062\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi063\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2024-02-22T19:07:33.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:33 smithi062 bash[67442]: audit 2024-02-22T19:07:32.976587+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-02-22T19:07:32.973095\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi062\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi063\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2024-02-22T19:07:33.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:33 smithi062 bash[67442]: cluster 2024-02-22T19:07:33.472350+0000 mgr.y (mgr.14140) 158 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:35.586 INFO:teuthology.orchestra.run.smithi063.stdout:Scheduled alertmanager update... 2024-02-22T19:07:36.198 DEBUG:teuthology.orchestra.run.smithi062:alertmanager.a> sudo journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@alertmanager.a.service 2024-02-22T19:07:36.201 INFO:tasks.cephadm:Adding grafana.a on smithi063 2024-02-22T19:07:36.201 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph orch apply grafana '1;smithi063=a' 2024-02-22T19:07:36.235 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:-- Logs begin at Thu 2024-02-22 18:41:31 UTC. -- 2024-02-22T19:07:36.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:36 smithi062 bash[64101]: cluster 2024-02-22T19:07:35.472713+0000 mgr.y (mgr.14140) 159 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:36.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:36 smithi062 bash[64101]: audit 2024-02-22T19:07:35.581494+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-02-22T19:07:35.581161\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi062\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2024-02-22T19:07:36.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:36 smithi062 bash[64101]: audit 2024-02-22T19:07:35.584328+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-02-22T19:07:35.581161\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi062\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2024-02-22T19:07:36.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:36 smithi062 bash[67442]: cluster 2024-02-22T19:07:35.472713+0000 mgr.y (mgr.14140) 159 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:36.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:36 smithi062 bash[67442]: audit 2024-02-22T19:07:35.581494+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-02-22T19:07:35.581161\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi062\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2024-02-22T19:07:36.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:36 smithi062 bash[67442]: audit 2024-02-22T19:07:35.584328+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-02-22T19:07:35.581161\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi062\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2024-02-22T19:07:36.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:36 smithi063 bash[35391]: cluster 2024-02-22T19:07:35.472713+0000 mgr.y (mgr.14140) 159 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:36.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:36 smithi063 bash[35391]: audit 2024-02-22T19:07:35.581494+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-02-22T19:07:35.581161\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi062\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2024-02-22T19:07:36.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:36 smithi063 bash[35391]: audit 2024-02-22T19:07:35.584328+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-02-22T19:07:35.581161\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi062\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2024-02-22T19:07:37.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:37 smithi063 bash[35391]: audit 2024-02-22T19:07:35.580633+0000 mgr.y (mgr.14140) 160 : audit [DBG] from='client.34301 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi062=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:07:37.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:37 smithi063 bash[35391]: cephadm 2024-02-22T19:07:35.581147+0000 mgr.y (mgr.14140) 161 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi062=a 2024-02-22T19:07:37.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:37 smithi062 bash[64101]: audit 2024-02-22T19:07:35.580633+0000 mgr.y (mgr.14140) 160 : audit [DBG] from='client.34301 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi062=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:07:37.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:37 smithi062 bash[64101]: cephadm 2024-02-22T19:07:35.581147+0000 mgr.y (mgr.14140) 161 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi062=a 2024-02-22T19:07:37.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:37 smithi062 bash[67442]: audit 2024-02-22T19:07:35.580633+0000 mgr.y (mgr.14140) 160 : audit [DBG] from='client.34301 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi062=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:07:37.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:37 smithi062 bash[67442]: cephadm 2024-02-22T19:07:35.581147+0000 mgr.y (mgr.14140) 161 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi062=a 2024-02-22T19:07:38.296 INFO:teuthology.orchestra.run.smithi063.stdout:Scheduled grafana update... 2024-02-22T19:07:38.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:38 smithi063 bash[35391]: cluster 2024-02-22T19:07:37.473029+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:38.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:38 smithi063 bash[35391]: audit 2024-02-22T19:07:38.292172+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-02-22T19:07:38.291793\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi063\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2024-02-22T19:07:38.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:38 smithi063 bash[35391]: audit 2024-02-22T19:07:38.295345+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-02-22T19:07:38.291793\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi063\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2024-02-22T19:07:38.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:38 smithi062 bash[64101]: cluster 2024-02-22T19:07:37.473029+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:38.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:38 smithi062 bash[64101]: audit 2024-02-22T19:07:38.292172+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-02-22T19:07:38.291793\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi063\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2024-02-22T19:07:38.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:38 smithi062 bash[64101]: audit 2024-02-22T19:07:38.295345+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-02-22T19:07:38.291793\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi063\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2024-02-22T19:07:38.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:38 smithi062 bash[67442]: cluster 2024-02-22T19:07:37.473029+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:38.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:38 smithi062 bash[67442]: audit 2024-02-22T19:07:38.292172+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-02-22T19:07:38.291793\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi063\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2024-02-22T19:07:38.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:38 smithi062 bash[67442]: audit 2024-02-22T19:07:38.295345+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-02-22T19:07:38.291793\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi063\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2024-02-22T19:07:39.398 DEBUG:teuthology.orchestra.run.smithi063:grafana.a> sudo journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@grafana.a.service 2024-02-22T19:07:39.401 INFO:tasks.cephadm:Setting up client nodes... 2024-02-22T19:07:39.402 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-22T19:07:39.433 INFO:journalctl@ceph.grafana.a.smithi063.stdout:-- Logs begin at Thu 2024-02-22 18:41:51 UTC. -- 2024-02-22T19:07:39.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:39 smithi063 bash[35391]: audit 2024-02-22T19:07:38.291223+0000 mgr.y (mgr.14140) 163 : audit [DBG] from='client.34307 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi063=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:07:39.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:39 smithi063 bash[35391]: cephadm 2024-02-22T19:07:38.291780+0000 mgr.y (mgr.14140) 164 : cephadm [INF] Saving service grafana spec with placement count:1 smithi063=a 2024-02-22T19:07:39.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:39 smithi062 bash[64101]: audit 2024-02-22T19:07:38.291223+0000 mgr.y (mgr.14140) 163 : audit [DBG] from='client.34307 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi063=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:07:39.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:39 smithi062 bash[64101]: cephadm 2024-02-22T19:07:38.291780+0000 mgr.y (mgr.14140) 164 : cephadm [INF] Saving service grafana spec with placement count:1 smithi063=a 2024-02-22T19:07:39.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:39 smithi062 bash[67442]: audit 2024-02-22T19:07:38.291223+0000 mgr.y (mgr.14140) 163 : audit [DBG] from='client.34307 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi063=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:07:39.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:39 smithi062 bash[67442]: cephadm 2024-02-22T19:07:38.291780+0000 mgr.y (mgr.14140) 164 : cephadm [INF] Saving service grafana spec with placement count:1 smithi063=a 2024-02-22T19:07:40.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:40 smithi062 bash[64101]: cluster 2024-02-22T19:07:39.473334+0000 mgr.y (mgr.14140) 165 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:40.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:40 smithi062 bash[67442]: cluster 2024-02-22T19:07:39.473334+0000 mgr.y (mgr.14140) 165 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:40.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:40 smithi063 bash[35391]: cluster 2024-02-22T19:07:39.473334+0000 mgr.y (mgr.14140) 165 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:41.523 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2024-02-22T19:07:41.523 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQB9m9dl5oD+HhAAHuQHNFMftwXk1D0k4UBE4Q== 2024-02-22T19:07:41.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:41 smithi062 bash[64101]: audit 2024-02-22T19:07:40.487295+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}, {\"id\": \"f51db05f-8460-4cbb-b032-3648e3dc166c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1708628810.0414464, \"finished_at\": 1708628821.3163216}, {\"id\": \"44ddf4df-f918-460c-b297-b0537537ee61\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708628827.7974782, \"finished_at\": 1708628840.7128322}, {\"id\": \"ada8fe35-2322-4aca-860c-670e7fcad3ac\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1708628847.5447533, \"finished_at\": 1708628856.45103}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-22T19:07:41.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:41 smithi062 bash[64101]: audit 2024-02-22T19:07:40.489455+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}, {\"id\": \"f51db05f-8460-4cbb-b032-3648e3dc166c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1708628810.0414464, \"finished_at\": 1708628821.3163216}, {\"id\": \"44ddf4df-f918-460c-b297-b0537537ee61\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708628827.7974782, \"finished_at\": 1708628840.7128322}, {\"id\": \"ada8fe35-2322-4aca-860c-670e7fcad3ac\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1708628847.5447533, \"finished_at\": 1708628856.45103}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-22T19:07:41.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:41 smithi062 bash[67442]: audit 2024-02-22T19:07:40.487295+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}, {\"id\": \"f51db05f-8460-4cbb-b032-3648e3dc166c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1708628810.0414464, \"finished_at\": 1708628821.3163216}, {\"id\": \"44ddf4df-f918-460c-b297-b0537537ee61\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708628827.7974782, \"finished_at\": 1708628840.7128322}, {\"id\": \"ada8fe35-2322-4aca-860c-670e7fcad3ac\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1708628847.5447533, \"finished_at\": 1708628856.45103}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-22T19:07:41.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:41 smithi062 bash[67442]: audit 2024-02-22T19:07:40.489455+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}, {\"id\": \"f51db05f-8460-4cbb-b032-3648e3dc166c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1708628810.0414464, \"finished_at\": 1708628821.3163216}, {\"id\": \"44ddf4df-f918-460c-b297-b0537537ee61\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708628827.7974782, \"finished_at\": 1708628840.7128322}, {\"id\": \"ada8fe35-2322-4aca-860c-670e7fcad3ac\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1708628847.5447533, \"finished_at\": 1708628856.45103}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-22T19:07:41.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:41 smithi063 bash[35391]: audit 2024-02-22T19:07:40.487295+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}, {\"id\": \"f51db05f-8460-4cbb-b032-3648e3dc166c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1708628810.0414464, \"finished_at\": 1708628821.3163216}, {\"id\": \"44ddf4df-f918-460c-b297-b0537537ee61\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708628827.7974782, \"finished_at\": 1708628840.7128322}, {\"id\": \"ada8fe35-2322-4aca-860c-670e7fcad3ac\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1708628847.5447533, \"finished_at\": 1708628856.45103}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-22T19:07:41.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:41 smithi063 bash[35391]: audit 2024-02-22T19:07:40.489455+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"e0947a92-1385-483a-a005-56e9ee552019\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708628788.4566467, \"finished_at\": 1708628802.1450849}, {\"id\": \"f51db05f-8460-4cbb-b032-3648e3dc166c\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1708628810.0414464, \"finished_at\": 1708628821.3163216}, {\"id\": \"44ddf4df-f918-460c-b297-b0537537ee61\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708628827.7974782, \"finished_at\": 1708628840.7128322}, {\"id\": \"ada8fe35-2322-4aca-860c-670e7fcad3ac\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1708628847.5447533, \"finished_at\": 1708628856.45103}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-22T19:07:42.359 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-22T19:07:42.359 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-22T19:07:42.359 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-22T19:07:42.405 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-22T19:07:42.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:42 smithi063 bash[35391]: cluster 2024-02-22T19:07:41.473590+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:42.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:42 smithi063 bash[35391]: audit 2024-02-22T19:07:41.519633+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.62:0/2855610779' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T19:07:42.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:42 smithi063 bash[35391]: audit 2024-02-22T19:07:41.519881+0000 mon.a (mon.0) 469 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T19:07:42.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:42 smithi063 bash[35391]: audit 2024-02-22T19:07:41.522783+0000 mon.a (mon.0) 470 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-22T19:07:42.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:42 smithi062 bash[64101]: cluster 2024-02-22T19:07:41.473590+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:42.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:42 smithi062 bash[64101]: audit 2024-02-22T19:07:41.519633+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.62:0/2855610779' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T19:07:42.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:42 smithi062 bash[64101]: audit 2024-02-22T19:07:41.519881+0000 mon.a (mon.0) 469 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T19:07:42.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:42 smithi062 bash[64101]: audit 2024-02-22T19:07:41.522783+0000 mon.a (mon.0) 470 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-22T19:07:42.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:42 smithi062 bash[67442]: cluster 2024-02-22T19:07:41.473590+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:42.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:42 smithi062 bash[67442]: audit 2024-02-22T19:07:41.519633+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.62:0/2855610779' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T19:07:42.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:42 smithi062 bash[67442]: audit 2024-02-22T19:07:41.519881+0000 mon.a (mon.0) 469 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T19:07:42.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:42 smithi062 bash[67442]: audit 2024-02-22T19:07:41.522783+0000 mon.a (mon.0) 470 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-22T19:07:44.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:44 smithi063 bash[35391]: cluster 2024-02-22T19:07:43.473995+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:44.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:44 smithi062 bash[64101]: cluster 2024-02-22T19:07:43.473995+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:44.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:44 smithi062 bash[67442]: cluster 2024-02-22T19:07:43.473995+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:46.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:46 smithi063 bash[35391]: cluster 2024-02-22T19:07:45.474481+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:46.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:46 smithi062 bash[64101]: cluster 2024-02-22T19:07:45.474481+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:46.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:46 smithi062 bash[67442]: cluster 2024-02-22T19:07:45.474481+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:46.953 INFO:teuthology.orchestra.run.smithi063.stdout:[client.1] 2024-02-22T19:07:46.954 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQCCm9dliLJ8OBAA1GPfi4O0A74ToL2WRFEGDw== 2024-02-22T19:07:47.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:47 smithi063 bash[35391]: audit 2024-02-22T19:07:46.947102+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.63:0/2201084195' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T19:07:47.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:47 smithi063 bash[35391]: audit 2024-02-22T19:07:46.947544+0000 mon.a (mon.0) 471 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T19:07:47.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:47 smithi063 bash[35391]: audit 2024-02-22T19:07:46.951117+0000 mon.a (mon.0) 472 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-22T19:07:47.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:47 smithi062 bash[64101]: audit 2024-02-22T19:07:46.947102+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.63:0/2201084195' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T19:07:47.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:47 smithi062 bash[64101]: audit 2024-02-22T19:07:46.947544+0000 mon.a (mon.0) 471 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T19:07:47.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:47 smithi062 bash[64101]: audit 2024-02-22T19:07:46.951117+0000 mon.a (mon.0) 472 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-22T19:07:47.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:47 smithi062 bash[67442]: audit 2024-02-22T19:07:46.947102+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.63:0/2201084195' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T19:07:47.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:47 smithi062 bash[67442]: audit 2024-02-22T19:07:46.947544+0000 mon.a (mon.0) 471 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-22T19:07:47.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:47 smithi062 bash[67442]: audit 2024-02-22T19:07:46.951117+0000 mon.a (mon.0) 472 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-22T19:07:48.273 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2024-02-22T19:07:48.273 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-22T19:07:48.273 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-22T19:07:48.315 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph osd dump --format=json 2024-02-22T19:07:48.656 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:48 smithi063 bash[35391]: cluster 2024-02-22T19:07:47.474943+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:48.657 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:48 smithi062 bash[64101]: cluster 2024-02-22T19:07:47.474943+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:48.657 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:48 smithi062 bash[67442]: cluster 2024-02-22T19:07:47.474943+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:50.208 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T19:07:50.208 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":47,"fsid":"e2bc0d14-d1b4-11ee-95bf-87774f69a715","created":"2024-02-22T19:02:43.815947+0000","modified":"2024-02-22T19:07:28.549344+0000","last_up_change":"2024-02-22T19:07:27.535904+0000","last_in_change":"2024-02-22T19:07:27.535904+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-22T19:02:55.521905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3658961562},{"type":"v1","addr":"172.21.15.62:6803","nonce":3658961562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3658961562},{"type":"v1","addr":"172.21.15.62:6805","nonce":3658961562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3658961562},{"type":"v1","addr":"172.21.15.62:6809","nonce":3658961562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3658961562},{"type":"v1","addr":"172.21.15.62:6807","nonce":3658961562}]},"public_addr":"172.21.15.62:6803/3658961562","cluster_addr":"172.21.15.62:6805/3658961562","heartbeat_back_addr":"172.21.15.62:6809/3658961562","heartbeat_front_addr":"172.21.15.62:6807/3658961562","state":["exists","up"]},{"osd":1,"uuid":"85b86909-3c43-46e4-8bc0-d4d3f86cb85a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1958140073},{"type":"v1","addr":"172.21.15.62:6811","nonce":1958140073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1958140073},{"type":"v1","addr":"172.21.15.62:6813","nonce":1958140073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1958140073},{"type":"v1","addr":"172.21.15.62:6817","nonce":1958140073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1958140073},{"type":"v1","addr":"172.21.15.62:6815","nonce":1958140073}]},"public_addr":"172.21.15.62:6811/1958140073","cluster_addr":"172.21.15.62:6813/1958140073","heartbeat_back_addr":"172.21.15.62:6817/1958140073","heartbeat_front_addr":"172.21.15.62:6815/1958140073","state":["exists","up"]},{"osd":2,"uuid":"5d915b66-d47b-4dd0-a6c4-7144de928112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3135175732},{"type":"v1","addr":"172.21.15.62:6819","nonce":3135175732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3135175732},{"type":"v1","addr":"172.21.15.62:6821","nonce":3135175732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3135175732},{"type":"v1","addr":"172.21.15.62:6825","nonce":3135175732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3135175732},{"type":"v1","addr":"172.21.15.62:6823","nonce":3135175732}]},"public_addr":"172.21.15.62:6819/3135175732","cluster_addr":"172.21.15.62:6821/3135175732","heartbeat_back_addr":"172.21.15.62:6825/3135175732","heartbeat_front_addr":"172.21.15.62:6823/3135175732","state":["exists","up"]},{"osd":3,"uuid":"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1626592673},{"type":"v1","addr":"172.21.15.62:6827","nonce":1626592673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":1626592673},{"type":"v1","addr":"172.21.15.62:6829","nonce":1626592673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1626592673},{"type":"v1","addr":"172.21.15.62:6833","nonce":1626592673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":1626592673},{"type":"v1","addr":"172.21.15.62:6831","nonce":1626592673}]},"public_addr":"172.21.15.62:6827/1626592673","cluster_addr":"172.21.15.62:6829/1626592673","heartbeat_back_addr":"172.21.15.62:6833/1626592673","heartbeat_front_addr":"172.21.15.62:6831/1626592673","state":["exists","up"]},{"osd":4,"uuid":"7fb59916-d40a-4445-a5f8-6d38a8750b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2291211912},{"type":"v1","addr":"172.21.15.63:6801","nonce":2291211912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2291211912},{"type":"v1","addr":"172.21.15.63:6803","nonce":2291211912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2291211912},{"type":"v1","addr":"172.21.15.63:6807","nonce":2291211912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2291211912},{"type":"v1","addr":"172.21.15.63:6805","nonce":2291211912}]},"public_addr":"172.21.15.63:6801/2291211912","cluster_addr":"172.21.15.63:6803/2291211912","heartbeat_back_addr":"172.21.15.63:6807/2291211912","heartbeat_front_addr":"172.21.15.63:6805/2291211912","state":["exists","up"]},{"osd":5,"uuid":"f67bd7fb-661e-4746-a736-7faf48782399","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":1349972101},{"type":"v1","addr":"172.21.15.63:6809","nonce":1349972101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":1349972101},{"type":"v1","addr":"172.21.15.63:6811","nonce":1349972101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":1349972101},{"type":"v1","addr":"172.21.15.63:6815","nonce":1349972101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":1349972101},{"type":"v1","addr":"172.21.15.63:6813","nonce":1349972101}]},"public_addr":"172.21.15.63:6809/1349972101","cluster_addr":"172.21.15.63:6811/1349972101","heartbeat_back_addr":"172.21.15.63:6815/1349972101","heartbeat_front_addr":"172.21.15.63:6813/1349972101","state":["exists","up"]},{"osd":6,"uuid":"0228dda5-c78b-479f-a7a0-4fe88baed26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3276064320},{"type":"v1","addr":"172.21.15.63:6817","nonce":3276064320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3276064320},{"type":"v1","addr":"172.21.15.63:6819","nonce":3276064320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3276064320},{"type":"v1","addr":"172.21.15.63:6823","nonce":3276064320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3276064320},{"type":"v1","addr":"172.21.15.63:6821","nonce":3276064320}]},"public_addr":"172.21.15.63:6817/3276064320","cluster_addr":"172.21.15.63:6819/3276064320","heartbeat_back_addr":"172.21.15.63:6823/3276064320","heartbeat_front_addr":"172.21.15.63:6821/3276064320","state":["exists","up"]},{"osd":7,"uuid":"70486b6f-31d1-487f-872d-f3ea7cc3d4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3078928935},{"type":"v1","addr":"172.21.15.63:6825","nonce":3078928935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3078928935},{"type":"v1","addr":"172.21.15.63:6827","nonce":3078928935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3078928935},{"type":"v1","addr":"172.21.15.63:6831","nonce":3078928935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3078928935},{"type":"v1","addr":"172.21.15.63:6829","nonce":3078928935}]},"public_addr":"172.21.15.63:6825/3078928935","cluster_addr":"172.21.15.63:6827/3078928935","heartbeat_back_addr":"172.21.15.63:6831/3078928935","heartbeat_front_addr":"172.21.15.63:6829/3078928935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:05:12.793922+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:05:32.884828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:05:50.773955+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:06:09.444467+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:06:26.851829+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:06:48.236722+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:07:06.369916+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:07:25.606920+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.62:0/2030480752":"2024-02-23T19:03:25.373485+0000","172.21.15.62:0/1695667212":"2024-02-23T19:03:25.373485+0000","172.21.15.62:0/3545899632":"2024-02-23T19:03:25.373485+0000","172.21.15.62:6800/686951691":"2024-02-23T19:03:25.373485+0000","172.21.15.62:6801/686951691":"2024-02-23T19:03:25.373485+0000","172.21.15.62:0/2038195977":"2024-02-23T19:03:04.422762+0000","172.21.15.62:0/3176223692":"2024-02-23T19:03:04.422762+0000","172.21.15.62:0/3302131045":"2024-02-23T19:03:04.422762+0000","172.21.15.62:6800/4224128405":"2024-02-23T19:03:04.422762+0000","172.21.15.62:6801/4224128405":"2024-02-23T19:03:04.422762+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-22T19:07:50.338 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:49 smithi063 podman[44147]: Error: no container with ID or name "ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-prometheus.a" found: no such container 2024-02-22T19:07:50.339 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:49 smithi063 systemd[1]: Started Ceph prometheus.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:07:50.590 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[35391]: cluster 2024-02-22T19:07:49.475351+0000 mgr.y (mgr.14140) 170 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:50.590 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[35391]: audit 2024-02-22T19:07:50.031795+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698451\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698530\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698565\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698596\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698627\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698679\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:50.590 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[35391]: audit 2024-02-22T19:07:50.037107+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698451\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698530\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698565\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698596\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698627\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698679\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:50.590 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[35391]: audit 2024-02-22T19:07:50.037741+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:07:50.590 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[35391]: audit 2024-02-22T19:07:50.205223+0000 mon.a (mon.0) 476 : audit [DBG] from='client.? 172.21.15.62:0/4123012397' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T19:07:50.783 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:50 smithi062 bash[64101]: cluster 2024-02-22T19:07:49.475351+0000 mgr.y (mgr.14140) 170 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:50.783 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:50 smithi062 bash[67442]: cluster 2024-02-22T19:07:49.475351+0000 mgr.y (mgr.14140) 170 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:50.784 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:50 smithi062 bash[64101]: audit 2024-02-22T19:07:50.031795+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698451\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698530\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698565\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698596\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698627\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698679\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:50.784 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:50 smithi062 bash[64101]: audit 2024-02-22T19:07:50.037107+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698451\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698530\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698565\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698596\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698627\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698679\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:50.784 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:50 smithi062 bash[64101]: audit 2024-02-22T19:07:50.037741+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:07:50.784 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:50 smithi062 bash[64101]: audit 2024-02-22T19:07:50.205223+0000 mon.a (mon.0) 476 : audit [DBG] from='client.? 172.21.15.62:0/4123012397' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T19:07:50.784 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:50 smithi062 bash[67442]: audit 2024-02-22T19:07:50.031795+0000 mon.a (mon.0) 473 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698451\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698530\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698565\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698596\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698627\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698679\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:50.785 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:50 smithi062 bash[67442]: audit 2024-02-22T19:07:50.037107+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698451\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698530\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698565\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698596\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698627\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:23.698679\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:50.785 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:50 smithi062 bash[67442]: audit 2024-02-22T19:07:50.037741+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:07:50.785 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:50 smithi062 bash[67442]: audit 2024-02-22T19:07:50.205223+0000 mon.a (mon.0) 476 : audit [DBG] from='client.? 172.21.15.62:0/4123012397' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T19:07:50.786 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-22T19:02:55.521905+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2024-02-22T19:07:50.786 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph osd pool get device_health_metrics pg_num 2024-02-22T19:07:50.964 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.687Z caller=main.go:564 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-02-22T19:07:50.964 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.687Z caller=main.go:608 level=info msg="Starting Prometheus Server" mode=server version="(version=2.50.0, branch=HEAD, revision=814b920e8a6345d35712b5857ebd4cb5e90fc107)" 2024-02-22T19:07:50.964 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.687Z caller=main.go:613 level=info build_context="(go=go1.21.7, platform=linux/amd64, user=root@384077e1cf50, date=20240222-09:38:19, tags=netgo,builtinassets,stringlabels)" 2024-02-22T19:07:50.964 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.687Z caller=main.go:614 level=info host_details="(Linux 4.18.0-540.el8.x86_64 #1 SMP Fri Feb 9 14:58:00 UTC 2024 x86_64 smithi063 (none))" 2024-02-22T19:07:50.964 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.687Z caller=main.go:615 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-02-22T19:07:50.964 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.687Z caller=main.go:616 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-22T19:07:50.964 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.689Z caller=web.go:565 level=info component=web msg="Start listening for connections" address=:9095 2024-02-22T19:07:50.964 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.689Z caller=main.go:1118 level=info msg="Starting TSDB ..." 2024-02-22T19:07:50.964 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.691Z caller=tls_config.go:313 level=info component=web msg="Listening on" address=[::]:9095 2024-02-22T19:07:50.964 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.691Z caller=tls_config.go:316 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-02-22T19:07:50.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.692Z caller=head.go:610 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-02-22T19:07:50.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.692Z caller=head.go:692 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.261µs 2024-02-22T19:07:50.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.692Z caller=head.go:700 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-02-22T19:07:50.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.693Z caller=head.go:771 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-02-22T19:07:50.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.693Z caller=head.go:808 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=38.504µs wal_replay_duration=186.377µs wbl_replay_duration=119ns total_replay_duration=245.472µs 2024-02-22T19:07:50.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.694Z caller=main.go:1139 level=info fs_type=XFS_SUPER_MAGIC 2024-02-22T19:07:50.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.694Z caller=main.go:1142 level=info msg="TSDB started" 2024-02-22T19:07:50.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.694Z caller=main.go:1324 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-22T19:07:50.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.695Z caller=main.go:1361 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=476.248µs db_storage=1.188µs remote_storage=1.02µs web_handler=306ns query_engine=721ns scrape=224.115µs scrape_sd=21.592µs notify=1.111µs notify_sd=820ns rules=36.714µs tracing=6.579µs 2024-02-22T19:07:50.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.695Z caller=main.go:1103 level=info msg="Server is ready to receive web requests." 2024-02-22T19:07:50.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:07:50 smithi063 bash[44164]: ts=2024-02-22T19:07:50.695Z caller=manager.go:146 level=info component="rule manager" msg="Starting rule manager..." 2024-02-22T19:07:52.535 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:52 smithi062 bash[67442]: cluster 2024-02-22T19:07:51.475790+0000 mgr.y (mgr.14140) 171 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:52.535 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:52 smithi062 bash[67442]: audit 2024-02-22T19:07:52.157041+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.155996\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156072\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156106\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156138\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156169\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156199\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156229\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}}, \"last_daemon_update\": \"2024-02-22T19:07:52.156303\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:52.535 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:52 smithi062 bash[67442]: audit 2024-02-22T19:07:52.160378+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.155996\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156072\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156106\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156138\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156169\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156199\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156229\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}}, \"last_daemon_update\": \"2024-02-22T19:07:52.156303\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:52.535 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:52 smithi062 bash[67442]: audit 2024-02-22T19:07:52.161664+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-02-22T19:07:52.536 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:52 smithi062 bash[67442]: audit 2024-02-22T19:07:52.162197+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:07:52.638 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:07:52 smithi063 systemd[1]: Starting Ceph node-exporter.b for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:07:52.638 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:52 smithi063 bash[35391]: cluster 2024-02-22T19:07:51.475790+0000 mgr.y (mgr.14140) 171 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:52.638 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:52 smithi063 bash[35391]: audit 2024-02-22T19:07:52.157041+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.155996\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156072\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156106\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156138\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156169\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156199\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156229\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}}, \"last_daemon_update\": \"2024-02-22T19:07:52.156303\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:52.639 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:52 smithi063 bash[35391]: audit 2024-02-22T19:07:52.160378+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.155996\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156072\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156106\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156138\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156169\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156199\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156229\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}}, \"last_daemon_update\": \"2024-02-22T19:07:52.156303\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:52.639 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:52 smithi063 bash[35391]: audit 2024-02-22T19:07:52.161664+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-02-22T19:07:52.639 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:52 smithi063 bash[35391]: audit 2024-02-22T19:07:52.162197+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:07:52.646 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2024-02-22T19:07:52.923 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:52 smithi062 bash[64101]: cluster 2024-02-22T19:07:51.475790+0000 mgr.y (mgr.14140) 171 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:52.923 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:52 smithi062 bash[64101]: audit 2024-02-22T19:07:52.157041+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.155996\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156072\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156106\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156138\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156169\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156199\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156229\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}}, \"last_daemon_update\": \"2024-02-22T19:07:52.156303\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:52.923 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:52 smithi062 bash[64101]: audit 2024-02-22T19:07:52.160378+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.155996\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156072\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156106\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156138\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156169\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156199\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156229\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}}, \"last_daemon_update\": \"2024-02-22T19:07:52.156303\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:52.923 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:52 smithi062 bash[64101]: audit 2024-02-22T19:07:52.161664+0000 mon.a (mon.0) 479 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-02-22T19:07:52.923 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:52 smithi062 bash[64101]: audit 2024-02-22T19:07:52.162197+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:07:52.963 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:07:52 smithi063 podman[44561]: Error: no container with ID or name "ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-node-exporter.b" found: no such container 2024-02-22T19:07:52.964 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:07:52 smithi063 systemd[1]: Started Ceph node-exporter.b for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:07:52.964 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:07:52 smithi063 bash[44579]: Resolving "prom/node-exporter" using unqualified-search registries (/etc/containers/registries.conf) 2024-02-22T19:07:52.964 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:07:52 smithi063 bash[44579]: Trying to pull docker.io/prom/node-exporter:latest... 2024-02-22T19:07:53.439 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-22T19:07:53.439 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-22T19:07:53.439 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph mgr dump --format=json 2024-02-22T19:07:53.734 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:07:53 smithi062 systemd[1]: Started Ceph node-exporter.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:07:53.734 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:07:53 smithi062 bash[75957]: Resolving "prom/node-exporter" using unqualified-search registries (/etc/containers/registries.conf) 2024-02-22T19:07:53.734 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:07:53 smithi062 bash[75957]: Trying to pull docker.io/prom/node-exporter:latest... 2024-02-22T19:07:53.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:53 smithi062 bash[64101]: cephadm 2024-02-22T19:07:52.162647+0000 mgr.y (mgr.14140) 172 : cephadm [INF] Deploying daemon node-exporter.b on smithi063 2024-02-22T19:07:53.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:53 smithi062 bash[64101]: audit 2024-02-22T19:07:52.646136+0000 mon.a (mon.0) 481 : audit [DBG] from='client.? 172.21.15.62:0/2952780169' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-22T19:07:53.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:53 smithi062 bash[67442]: cephadm 2024-02-22T19:07:52.162647+0000 mgr.y (mgr.14140) 172 : cephadm [INF] Deploying daemon node-exporter.b on smithi063 2024-02-22T19:07:53.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:53 smithi062 bash[67442]: audit 2024-02-22T19:07:52.646136+0000 mon.a (mon.0) 481 : audit [DBG] from='client.? 172.21.15.62:0/2952780169' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-22T19:07:53.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:53 smithi062 bash[64101]: audit 2024-02-22T19:07:52.703053+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.155996\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156072\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156106\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156138\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156169\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156199\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156229\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:53.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:53 smithi062 bash[67442]: audit 2024-02-22T19:07:52.703053+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.155996\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156072\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156106\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156138\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156169\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156199\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156229\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:53.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:53 smithi062 bash[64101]: audit 2024-02-22T19:07:52.706862+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.155996\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156072\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156106\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156138\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156169\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156199\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156229\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:53.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:53 smithi062 bash[64101]: audit 2024-02-22T19:07:52.707495+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-02-22T19:07:53.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:53 smithi062 bash[64101]: audit 2024-02-22T19:07:52.708123+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:07:53.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:53 smithi062 bash[67442]: audit 2024-02-22T19:07:52.706862+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.155996\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156072\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156106\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156138\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156169\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156199\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156229\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:53.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:53 smithi062 bash[67442]: audit 2024-02-22T19:07:52.707495+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-02-22T19:07:53.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:53 smithi062 bash[67442]: audit 2024-02-22T19:07:52.708123+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:07:53.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:53 smithi062 bash[64101]: audit 2024-02-22T19:07:53.491985+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:07:53.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:53 smithi062 bash[64101]: audit 2024-02-22T19:07:53.495764+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:07:53.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:53 smithi062 bash[67442]: audit 2024-02-22T19:07:53.491985+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:07:53.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:53 smithi062 bash[67442]: audit 2024-02-22T19:07:53.495764+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:07:53.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:53 smithi063 bash[35391]: cephadm 2024-02-22T19:07:52.162647+0000 mgr.y (mgr.14140) 172 : cephadm [INF] Deploying daemon node-exporter.b on smithi063 2024-02-22T19:07:53.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:53 smithi063 bash[35391]: audit 2024-02-22T19:07:52.646136+0000 mon.a (mon.0) 481 : audit [DBG] from='client.? 172.21.15.62:0/2952780169' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-22T19:07:53.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:53 smithi063 bash[35391]: audit 2024-02-22T19:07:52.703053+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.155996\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156072\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156106\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156138\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156169\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156199\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156229\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:07:53.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:53 smithi063 bash[35391]: audit 2024-02-22T19:07:52.706862+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.155996\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156072\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156106\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156138\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156169\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156199\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156229\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:07:53.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:53 smithi063 bash[35391]: audit 2024-02-22T19:07:52.707495+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-02-22T19:07:53.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:53 smithi063 bash[35391]: audit 2024-02-22T19:07:52.708123+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:07:53.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:53 smithi063 bash[35391]: audit 2024-02-22T19:07:53.491985+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:07:53.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:53 smithi063 bash[35391]: audit 2024-02-22T19:07:53.495764+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:07:54.869 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:54 smithi062 bash[64101]: cephadm 2024-02-22T19:07:52.708582+0000 mgr.y (mgr.14140) 173 : cephadm [INF] Deploying daemon node-exporter.a on smithi062 2024-02-22T19:07:54.869 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:54 smithi062 bash[64101]: cluster 2024-02-22T19:07:53.476132+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:54.869 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:54 smithi062 bash[64101]: cephadm 2024-02-22T19:07:53.498123+0000 mgr.y (mgr.14140) 175 : cephadm [INF] Deploying daemon alertmanager.a on smithi062 2024-02-22T19:07:54.869 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:54 smithi062 bash[67442]: cephadm 2024-02-22T19:07:52.708582+0000 mgr.y (mgr.14140) 173 : cephadm [INF] Deploying daemon node-exporter.a on smithi062 2024-02-22T19:07:54.869 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:54 smithi062 bash[67442]: cluster 2024-02-22T19:07:53.476132+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:54.869 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:54 smithi062 bash[67442]: cephadm 2024-02-22T19:07:53.498123+0000 mgr.y (mgr.14140) 175 : cephadm [INF] Deploying daemon alertmanager.a on smithi062 2024-02-22T19:07:54.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:54 smithi063 bash[35391]: cephadm 2024-02-22T19:07:52.708582+0000 mgr.y (mgr.14140) 173 : cephadm [INF] Deploying daemon node-exporter.a on smithi062 2024-02-22T19:07:54.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:54 smithi063 bash[35391]: cluster 2024-02-22T19:07:53.476132+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:54.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:54 smithi063 bash[35391]: cephadm 2024-02-22T19:07:53.498123+0000 mgr.y (mgr.14140) 175 : cephadm [INF] Deploying daemon alertmanager.a on smithi062 2024-02-22T19:07:55.510 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T19:07:56.179 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":14,"active_gid":14140,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3392338990},{"type":"v1","addr":"172.21.15.62:6801","nonce":3392338990}]},"active_addr":"172.21.15.62:6801/3392338990","active_change":"2024-02-22T19:03:25.373818+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":24106,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi062.front.sepia.ceph.com:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":5,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":2304279965}]},{"addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":1517619151}]},{"addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":1722302779}]}]}} 2024-02-22T19:07:56.182 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-22T19:07:56.182 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-22T19:07:56.182 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph osd dump --format=json 2024-02-22T19:07:56.454 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:56 smithi062 bash[67442]: cluster 2024-02-22T19:07:55.476545+0000 mgr.y (mgr.14140) 176 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:56.454 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:56 smithi062 bash[67442]: audit 2024-02-22T19:07:55.506186+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.15.62:0/3798884638' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-22T19:07:56.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:56 smithi063 bash[35391]: cluster 2024-02-22T19:07:55.476545+0000 mgr.y (mgr.14140) 176 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:56.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:56 smithi063 bash[35391]: audit 2024-02-22T19:07:55.506186+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.15.62:0/3798884638' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-22T19:07:56.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:56 smithi062 bash[64101]: cluster 2024-02-22T19:07:55.476545+0000 mgr.y (mgr.14140) 176 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:56.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:56 smithi062 bash[64101]: audit 2024-02-22T19:07:55.506186+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.15.62:0/3798884638' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-22T19:07:58.108 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T19:07:58.108 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":47,"fsid":"e2bc0d14-d1b4-11ee-95bf-87774f69a715","created":"2024-02-22T19:02:43.815947+0000","modified":"2024-02-22T19:07:28.549344+0000","last_up_change":"2024-02-22T19:07:27.535904+0000","last_in_change":"2024-02-22T19:07:27.535904+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-22T19:02:55.521905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3658961562},{"type":"v1","addr":"172.21.15.62:6803","nonce":3658961562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3658961562},{"type":"v1","addr":"172.21.15.62:6805","nonce":3658961562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3658961562},{"type":"v1","addr":"172.21.15.62:6809","nonce":3658961562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3658961562},{"type":"v1","addr":"172.21.15.62:6807","nonce":3658961562}]},"public_addr":"172.21.15.62:6803/3658961562","cluster_addr":"172.21.15.62:6805/3658961562","heartbeat_back_addr":"172.21.15.62:6809/3658961562","heartbeat_front_addr":"172.21.15.62:6807/3658961562","state":["exists","up"]},{"osd":1,"uuid":"85b86909-3c43-46e4-8bc0-d4d3f86cb85a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1958140073},{"type":"v1","addr":"172.21.15.62:6811","nonce":1958140073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1958140073},{"type":"v1","addr":"172.21.15.62:6813","nonce":1958140073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1958140073},{"type":"v1","addr":"172.21.15.62:6817","nonce":1958140073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1958140073},{"type":"v1","addr":"172.21.15.62:6815","nonce":1958140073}]},"public_addr":"172.21.15.62:6811/1958140073","cluster_addr":"172.21.15.62:6813/1958140073","heartbeat_back_addr":"172.21.15.62:6817/1958140073","heartbeat_front_addr":"172.21.15.62:6815/1958140073","state":["exists","up"]},{"osd":2,"uuid":"5d915b66-d47b-4dd0-a6c4-7144de928112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3135175732},{"type":"v1","addr":"172.21.15.62:6819","nonce":3135175732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3135175732},{"type":"v1","addr":"172.21.15.62:6821","nonce":3135175732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3135175732},{"type":"v1","addr":"172.21.15.62:6825","nonce":3135175732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3135175732},{"type":"v1","addr":"172.21.15.62:6823","nonce":3135175732}]},"public_addr":"172.21.15.62:6819/3135175732","cluster_addr":"172.21.15.62:6821/3135175732","heartbeat_back_addr":"172.21.15.62:6825/3135175732","heartbeat_front_addr":"172.21.15.62:6823/3135175732","state":["exists","up"]},{"osd":3,"uuid":"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1626592673},{"type":"v1","addr":"172.21.15.62:6827","nonce":1626592673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":1626592673},{"type":"v1","addr":"172.21.15.62:6829","nonce":1626592673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1626592673},{"type":"v1","addr":"172.21.15.62:6833","nonce":1626592673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":1626592673},{"type":"v1","addr":"172.21.15.62:6831","nonce":1626592673}]},"public_addr":"172.21.15.62:6827/1626592673","cluster_addr":"172.21.15.62:6829/1626592673","heartbeat_back_addr":"172.21.15.62:6833/1626592673","heartbeat_front_addr":"172.21.15.62:6831/1626592673","state":["exists","up"]},{"osd":4,"uuid":"7fb59916-d40a-4445-a5f8-6d38a8750b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2291211912},{"type":"v1","addr":"172.21.15.63:6801","nonce":2291211912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2291211912},{"type":"v1","addr":"172.21.15.63:6803","nonce":2291211912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2291211912},{"type":"v1","addr":"172.21.15.63:6807","nonce":2291211912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2291211912},{"type":"v1","addr":"172.21.15.63:6805","nonce":2291211912}]},"public_addr":"172.21.15.63:6801/2291211912","cluster_addr":"172.21.15.63:6803/2291211912","heartbeat_back_addr":"172.21.15.63:6807/2291211912","heartbeat_front_addr":"172.21.15.63:6805/2291211912","state":["exists","up"]},{"osd":5,"uuid":"f67bd7fb-661e-4746-a736-7faf48782399","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":1349972101},{"type":"v1","addr":"172.21.15.63:6809","nonce":1349972101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":1349972101},{"type":"v1","addr":"172.21.15.63:6811","nonce":1349972101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":1349972101},{"type":"v1","addr":"172.21.15.63:6815","nonce":1349972101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":1349972101},{"type":"v1","addr":"172.21.15.63:6813","nonce":1349972101}]},"public_addr":"172.21.15.63:6809/1349972101","cluster_addr":"172.21.15.63:6811/1349972101","heartbeat_back_addr":"172.21.15.63:6815/1349972101","heartbeat_front_addr":"172.21.15.63:6813/1349972101","state":["exists","up"]},{"osd":6,"uuid":"0228dda5-c78b-479f-a7a0-4fe88baed26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3276064320},{"type":"v1","addr":"172.21.15.63:6817","nonce":3276064320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3276064320},{"type":"v1","addr":"172.21.15.63:6819","nonce":3276064320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3276064320},{"type":"v1","addr":"172.21.15.63:6823","nonce":3276064320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3276064320},{"type":"v1","addr":"172.21.15.63:6821","nonce":3276064320}]},"public_addr":"172.21.15.63:6817/3276064320","cluster_addr":"172.21.15.63:6819/3276064320","heartbeat_back_addr":"172.21.15.63:6823/3276064320","heartbeat_front_addr":"172.21.15.63:6821/3276064320","state":["exists","up"]},{"osd":7,"uuid":"70486b6f-31d1-487f-872d-f3ea7cc3d4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3078928935},{"type":"v1","addr":"172.21.15.63:6825","nonce":3078928935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3078928935},{"type":"v1","addr":"172.21.15.63:6827","nonce":3078928935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3078928935},{"type":"v1","addr":"172.21.15.63:6831","nonce":3078928935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3078928935},{"type":"v1","addr":"172.21.15.63:6829","nonce":3078928935}]},"public_addr":"172.21.15.63:6825/3078928935","cluster_addr":"172.21.15.63:6827/3078928935","heartbeat_back_addr":"172.21.15.63:6831/3078928935","heartbeat_front_addr":"172.21.15.63:6829/3078928935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:05:12.793922+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:05:32.884828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:05:50.773955+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:06:09.444467+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:06:26.851829+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:06:48.236722+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:07:06.369916+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:07:25.606920+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.62:0/2030480752":"2024-02-23T19:03:25.373485+0000","172.21.15.62:0/1695667212":"2024-02-23T19:03:25.373485+0000","172.21.15.62:0/3545899632":"2024-02-23T19:03:25.373485+0000","172.21.15.62:6800/686951691":"2024-02-23T19:03:25.373485+0000","172.21.15.62:6801/686951691":"2024-02-23T19:03:25.373485+0000","172.21.15.62:0/2038195977":"2024-02-23T19:03:04.422762+0000","172.21.15.62:0/3176223692":"2024-02-23T19:03:04.422762+0000","172.21.15.62:0/3302131045":"2024-02-23T19:03:04.422762+0000","172.21.15.62:6800/4224128405":"2024-02-23T19:03:04.422762+0000","172.21.15.62:6801/4224128405":"2024-02-23T19:03:04.422762+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-22T19:07:58.704 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:58 smithi062 bash[64101]: cluster 2024-02-22T19:07:57.476965+0000 mgr.y (mgr.14140) 177 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:58.705 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:07:58 smithi062 bash[64101]: audit 2024-02-22T19:07:58.106602+0000 mon.a (mon.0) 488 : audit [DBG] from='client.? 172.21.15.62:0/1968391669' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T19:07:58.705 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:58 smithi062 bash[67442]: cluster 2024-02-22T19:07:57.476965+0000 mgr.y (mgr.14140) 177 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:58.705 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:07:58 smithi062 bash[67442]: audit 2024-02-22T19:07:58.106602+0000 mon.a (mon.0) 488 : audit [DBG] from='client.? 172.21.15.62:0/1968391669' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T19:07:58.716 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-22T19:07:58.717 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph osd dump --format=json 2024-02-22T19:07:58.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:58 smithi063 bash[35391]: cluster 2024-02-22T19:07:57.476965+0000 mgr.y (mgr.14140) 177 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:07:58.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:07:58 smithi063 bash[35391]: audit 2024-02-22T19:07:58.106602+0000 mon.a (mon.0) 488 : audit [DBG] from='client.? 172.21.15.62:0/1968391669' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T19:07:59.713 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:07:59 smithi063 bash[44579]: Getting image source signatures 2024-02-22T19:07:59.714 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:07:59 smithi063 bash[44579]: Copying blob sha256:324153f2810a9927fcce320af9e4e291e0b6e805cbdd1f338386c756b9defa24 2024-02-22T19:07:59.714 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:07:59 smithi063 bash[44579]: Copying blob sha256:2abcce694348cd2c949c0e98a7400ebdfd8341021bcf6b541bc72033ce982510 2024-02-22T19:07:59.714 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:07:59 smithi063 bash[44579]: Copying blob sha256:455fd88e5221bc1e278ef2d059cd70e4df99a24e5af050ede621534276f6cf9a 2024-02-22T19:08:00.389 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:00 smithi062 bash[75957]: Getting image source signatures 2024-02-22T19:08:00.389 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:00 smithi062 bash[75957]: Copying blob sha256:324153f2810a9927fcce320af9e4e291e0b6e805cbdd1f338386c756b9defa24 2024-02-22T19:08:00.389 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:00 smithi062 bash[75957]: Copying blob sha256:455fd88e5221bc1e278ef2d059cd70e4df99a24e5af050ede621534276f6cf9a 2024-02-22T19:08:00.389 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:00 smithi062 bash[75957]: Copying blob sha256:2abcce694348cd2c949c0e98a7400ebdfd8341021bcf6b541bc72033ce982510 2024-02-22T19:08:00.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:00 smithi062 bash[64101]: cluster 2024-02-22T19:07:59.477345+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:00.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:00 smithi062 bash[67442]: cluster 2024-02-22T19:07:59.477345+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:00.813 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T19:08:00.813 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":47,"fsid":"e2bc0d14-d1b4-11ee-95bf-87774f69a715","created":"2024-02-22T19:02:43.815947+0000","modified":"2024-02-22T19:07:28.549344+0000","last_up_change":"2024-02-22T19:07:27.535904+0000","last_in_change":"2024-02-22T19:07:27.535904+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-22T19:02:55.521905+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3658961562},{"type":"v1","addr":"172.21.15.62:6803","nonce":3658961562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3658961562},{"type":"v1","addr":"172.21.15.62:6805","nonce":3658961562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":3658961562},{"type":"v1","addr":"172.21.15.62:6809","nonce":3658961562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3658961562},{"type":"v1","addr":"172.21.15.62:6807","nonce":3658961562}]},"public_addr":"172.21.15.62:6803/3658961562","cluster_addr":"172.21.15.62:6805/3658961562","heartbeat_back_addr":"172.21.15.62:6809/3658961562","heartbeat_front_addr":"172.21.15.62:6807/3658961562","state":["exists","up"]},{"osd":1,"uuid":"85b86909-3c43-46e4-8bc0-d4d3f86cb85a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":1958140073},{"type":"v1","addr":"172.21.15.62:6811","nonce":1958140073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":1958140073},{"type":"v1","addr":"172.21.15.62:6813","nonce":1958140073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":1958140073},{"type":"v1","addr":"172.21.15.62:6817","nonce":1958140073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":1958140073},{"type":"v1","addr":"172.21.15.62:6815","nonce":1958140073}]},"public_addr":"172.21.15.62:6811/1958140073","cluster_addr":"172.21.15.62:6813/1958140073","heartbeat_back_addr":"172.21.15.62:6817/1958140073","heartbeat_front_addr":"172.21.15.62:6815/1958140073","state":["exists","up"]},{"osd":2,"uuid":"5d915b66-d47b-4dd0-a6c4-7144de928112","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3135175732},{"type":"v1","addr":"172.21.15.62:6819","nonce":3135175732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3135175732},{"type":"v1","addr":"172.21.15.62:6821","nonce":3135175732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":3135175732},{"type":"v1","addr":"172.21.15.62:6825","nonce":3135175732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3135175732},{"type":"v1","addr":"172.21.15.62:6823","nonce":3135175732}]},"public_addr":"172.21.15.62:6819/3135175732","cluster_addr":"172.21.15.62:6821/3135175732","heartbeat_back_addr":"172.21.15.62:6825/3135175732","heartbeat_front_addr":"172.21.15.62:6823/3135175732","state":["exists","up"]},{"osd":3,"uuid":"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1626592673},{"type":"v1","addr":"172.21.15.62:6827","nonce":1626592673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":1626592673},{"type":"v1","addr":"172.21.15.62:6829","nonce":1626592673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":1626592673},{"type":"v1","addr":"172.21.15.62:6833","nonce":1626592673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":1626592673},{"type":"v1","addr":"172.21.15.62:6831","nonce":1626592673}]},"public_addr":"172.21.15.62:6827/1626592673","cluster_addr":"172.21.15.62:6829/1626592673","heartbeat_back_addr":"172.21.15.62:6833/1626592673","heartbeat_front_addr":"172.21.15.62:6831/1626592673","state":["exists","up"]},{"osd":4,"uuid":"7fb59916-d40a-4445-a5f8-6d38a8750b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":2291211912},{"type":"v1","addr":"172.21.15.63:6801","nonce":2291211912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":2291211912},{"type":"v1","addr":"172.21.15.63:6803","nonce":2291211912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":2291211912},{"type":"v1","addr":"172.21.15.63:6807","nonce":2291211912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6804","nonce":2291211912},{"type":"v1","addr":"172.21.15.63:6805","nonce":2291211912}]},"public_addr":"172.21.15.63:6801/2291211912","cluster_addr":"172.21.15.63:6803/2291211912","heartbeat_back_addr":"172.21.15.63:6807/2291211912","heartbeat_front_addr":"172.21.15.63:6805/2291211912","state":["exists","up"]},{"osd":5,"uuid":"f67bd7fb-661e-4746-a736-7faf48782399","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6808","nonce":1349972101},{"type":"v1","addr":"172.21.15.63:6809","nonce":1349972101}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":1349972101},{"type":"v1","addr":"172.21.15.63:6811","nonce":1349972101}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":1349972101},{"type":"v1","addr":"172.21.15.63:6815","nonce":1349972101}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6812","nonce":1349972101},{"type":"v1","addr":"172.21.15.63:6813","nonce":1349972101}]},"public_addr":"172.21.15.63:6809/1349972101","cluster_addr":"172.21.15.63:6811/1349972101","heartbeat_back_addr":"172.21.15.63:6815/1349972101","heartbeat_front_addr":"172.21.15.63:6813/1349972101","state":["exists","up"]},{"osd":6,"uuid":"0228dda5-c78b-479f-a7a0-4fe88baed26d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3276064320},{"type":"v1","addr":"172.21.15.63:6817","nonce":3276064320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3276064320},{"type":"v1","addr":"172.21.15.63:6819","nonce":3276064320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6822","nonce":3276064320},{"type":"v1","addr":"172.21.15.63:6823","nonce":3276064320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":3276064320},{"type":"v1","addr":"172.21.15.63:6821","nonce":3276064320}]},"public_addr":"172.21.15.63:6817/3276064320","cluster_addr":"172.21.15.63:6819/3276064320","heartbeat_back_addr":"172.21.15.63:6823/3276064320","heartbeat_front_addr":"172.21.15.63:6821/3276064320","state":["exists","up"]},{"osd":7,"uuid":"70486b6f-31d1-487f-872d-f3ea7cc3d4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":3078928935},{"type":"v1","addr":"172.21.15.63:6825","nonce":3078928935}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6826","nonce":3078928935},{"type":"v1","addr":"172.21.15.63:6827","nonce":3078928935}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":3078928935},{"type":"v1","addr":"172.21.15.63:6831","nonce":3078928935}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":3078928935},{"type":"v1","addr":"172.21.15.63:6829","nonce":3078928935}]},"public_addr":"172.21.15.63:6825/3078928935","cluster_addr":"172.21.15.63:6827/3078928935","heartbeat_back_addr":"172.21.15.63:6831/3078928935","heartbeat_front_addr":"172.21.15.63:6829/3078928935","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:05:12.793922+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:05:32.884828+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:05:50.773955+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:06:09.444467+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:06:26.851829+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:06:48.236722+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:07:06.369916+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-22T19:07:25.606920+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.62:0/2030480752":"2024-02-23T19:03:25.373485+0000","172.21.15.62:0/1695667212":"2024-02-23T19:03:25.373485+0000","172.21.15.62:0/3545899632":"2024-02-23T19:03:25.373485+0000","172.21.15.62:6800/686951691":"2024-02-23T19:03:25.373485+0000","172.21.15.62:6801/686951691":"2024-02-23T19:03:25.373485+0000","172.21.15.62:0/2038195977":"2024-02-23T19:03:04.422762+0000","172.21.15.62:0/3176223692":"2024-02-23T19:03:04.422762+0000","172.21.15.62:0/3302131045":"2024-02-23T19:03:04.422762+0000","172.21.15.62:6800/4224128405":"2024-02-23T19:03:04.422762+0000","172.21.15.62:6801/4224128405":"2024-02-23T19:03:04.422762+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-22T19:08:00.877 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:00 smithi063 bash[35391]: cluster 2024-02-22T19:07:59.477345+0000 mgr.y (mgr.14140) 178 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:01.213 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:00 smithi063 bash[44579]: Copying config sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e 2024-02-22T19:08:01.214 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: Writing manifest to image destination 2024-02-22T19:08:01.775 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[35391]: audit 2024-02-22T19:08:00.812370+0000 mon.a (mon.0) 489 : audit [DBG] from='client.? 172.21.15.62:0/584448985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T19:08:01.803 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:01 smithi062 bash[64101]: audit 2024-02-22T19:08:00.812370+0000 mon.a (mon.0) 489 : audit [DBG] from='client.? 172.21.15.62:0/584448985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T19:08:01.803 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:01 smithi062 bash[67442]: audit 2024-02-22T19:08:00.812370+0000 mon.a (mon.0) 489 : audit [DBG] from='client.? 172.21.15.62:0/584448985' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-22T19:08:01.813 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-22T19:08:02.214 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.675Z caller=node_exporter.go:192 level=info msg="Starting node_exporter" version="(version=1.7.0, branch=HEAD, revision=7333465abf9efba81876303bb57e6fadb946041b)" 2024-02-22T19:08:02.214 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.675Z caller=node_exporter.go:193 level=info msg="Build context" build_context="(go=go1.21.4, platform=linux/amd64, user=root@35918982f6d8, date=20231112-23:53:35, tags=netgo osusergo static_build)" 2024-02-22T19:08:02.214 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-02-22T19:08:02.214 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-02-22T19:08:02.214 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-02-22T19:08:02.214 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-02-22T19:08:02.215 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-02-22T19:08:02.215 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=arp 2024-02-22T19:08:02.215 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=bcache 2024-02-22T19:08:02.215 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=bonding 2024-02-22T19:08:02.215 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=btrfs 2024-02-22T19:08:02.215 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=conntrack 2024-02-22T19:08:02.215 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=cpu 2024-02-22T19:08:02.215 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-02-22T19:08:02.215 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=diskstats 2024-02-22T19:08:02.215 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=dmi 2024-02-22T19:08:02.215 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=edac 2024-02-22T19:08:02.215 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=entropy 2024-02-22T19:08:02.215 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-02-22T19:08:02.215 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=filefd 2024-02-22T19:08:02.216 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=filesystem 2024-02-22T19:08:02.216 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=hwmon 2024-02-22T19:08:02.216 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=infiniband 2024-02-22T19:08:02.216 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=ipvs 2024-02-22T19:08:02.216 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=loadavg 2024-02-22T19:08:02.216 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=mdadm 2024-02-22T19:08:02.216 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=meminfo 2024-02-22T19:08:02.216 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=netclass 2024-02-22T19:08:02.216 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=netdev 2024-02-22T19:08:02.216 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=netstat 2024-02-22T19:08:02.216 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=nfs 2024-02-22T19:08:02.216 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=nfsd 2024-02-22T19:08:02.216 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=nvme 2024-02-22T19:08:02.216 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=os 2024-02-22T19:08:02.217 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-02-22T19:08:02.217 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=pressure 2024-02-22T19:08:02.217 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.676Z caller=node_exporter.go:117 level=info collector=rapl 2024-02-22T19:08:02.217 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.677Z caller=node_exporter.go:117 level=info collector=schedstat 2024-02-22T19:08:02.217 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.677Z caller=node_exporter.go:117 level=info collector=selinux 2024-02-22T19:08:02.217 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.677Z caller=node_exporter.go:117 level=info collector=sockstat 2024-02-22T19:08:02.217 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.677Z caller=node_exporter.go:117 level=info collector=softnet 2024-02-22T19:08:02.217 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.677Z caller=node_exporter.go:117 level=info collector=stat 2024-02-22T19:08:02.217 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.677Z caller=node_exporter.go:117 level=info collector=tapestats 2024-02-22T19:08:02.217 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.677Z caller=node_exporter.go:117 level=info collector=textfile 2024-02-22T19:08:02.217 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.677Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-02-22T19:08:02.217 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.677Z caller=node_exporter.go:117 level=info collector=time 2024-02-22T19:08:02.217 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.677Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-02-22T19:08:02.217 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.677Z caller=node_exporter.go:117 level=info collector=uname 2024-02-22T19:08:02.217 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.677Z caller=node_exporter.go:117 level=info collector=vmstat 2024-02-22T19:08:02.218 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.677Z caller=node_exporter.go:117 level=info collector=xfs 2024-02-22T19:08:02.218 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.677Z caller=node_exporter.go:117 level=info collector=zfs 2024-02-22T19:08:02.218 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.677Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9100 2024-02-22T19:08:02.218 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:08:01 smithi063 bash[44579]: ts=2024-02-22T19:08:01.677Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-02-22T19:08:02.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:02 smithi063 bash[35391]: cluster 2024-02-22T19:08:01.477727+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:02.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:02 smithi062 bash[64101]: cluster 2024-02-22T19:08:01.477727+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:02.985 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:02 smithi062 bash[75957]: Copying config sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e 2024-02-22T19:08:02.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:02 smithi062 bash[67442]: cluster 2024-02-22T19:08:01.477727+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:03.484 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:02 smithi062 bash[75957]: Writing manifest to image destination 2024-02-22T19:08:04.942 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[64101]: cluster 2024-02-22T19:08:03.477971+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:04.942 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[67442]: cluster 2024-02-22T19:08:03.477971+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:04.943 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.575Z caller=node_exporter.go:192 level=info msg="Starting node_exporter" version="(version=1.7.0, branch=HEAD, revision=7333465abf9efba81876303bb57e6fadb946041b)" 2024-02-22T19:08:04.943 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.575Z caller=node_exporter.go:193 level=info msg="Build context" build_context="(go=go1.21.4, platform=linux/amd64, user=root@35918982f6d8, date=20231112-23:53:35, tags=netgo osusergo static_build)" 2024-02-22T19:08:04.943 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.576Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-02-22T19:08:04.943 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.576Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-02-22T19:08:04.943 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.576Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-02-22T19:08:04.943 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.576Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-02-22T19:08:04.943 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-02-22T19:08:04.943 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=arp 2024-02-22T19:08:04.943 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=bcache 2024-02-22T19:08:04.943 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=bonding 2024-02-22T19:08:04.943 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=btrfs 2024-02-22T19:08:04.943 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=conntrack 2024-02-22T19:08:04.944 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=cpu 2024-02-22T19:08:04.944 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-02-22T19:08:04.944 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=diskstats 2024-02-22T19:08:04.944 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=dmi 2024-02-22T19:08:04.944 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=edac 2024-02-22T19:08:04.944 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=entropy 2024-02-22T19:08:04.944 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-02-22T19:08:04.944 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=filefd 2024-02-22T19:08:04.944 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=filesystem 2024-02-22T19:08:04.944 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=hwmon 2024-02-22T19:08:04.944 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=infiniband 2024-02-22T19:08:04.944 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=ipvs 2024-02-22T19:08:04.944 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=loadavg 2024-02-22T19:08:04.944 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=mdadm 2024-02-22T19:08:04.944 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=meminfo 2024-02-22T19:08:04.945 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=netclass 2024-02-22T19:08:04.945 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=netdev 2024-02-22T19:08:04.945 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=netstat 2024-02-22T19:08:04.945 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=nfs 2024-02-22T19:08:04.945 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=nfsd 2024-02-22T19:08:04.945 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=nvme 2024-02-22T19:08:04.945 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=os 2024-02-22T19:08:04.945 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-02-22T19:08:04.945 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=pressure 2024-02-22T19:08:04.945 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=rapl 2024-02-22T19:08:04.945 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=schedstat 2024-02-22T19:08:04.945 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=selinux 2024-02-22T19:08:04.945 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=sockstat 2024-02-22T19:08:04.945 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=softnet 2024-02-22T19:08:04.945 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=stat 2024-02-22T19:08:04.945 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=tapestats 2024-02-22T19:08:04.946 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=textfile 2024-02-22T19:08:04.946 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-02-22T19:08:04.946 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=time 2024-02-22T19:08:04.946 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-02-22T19:08:04.946 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=uname 2024-02-22T19:08:04.946 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=vmstat 2024-02-22T19:08:04.946 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=xfs 2024-02-22T19:08:04.946 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=node_exporter.go:117 level=info collector=zfs 2024-02-22T19:08:04.946 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9100 2024-02-22T19:08:04.946 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:08:04 smithi062 bash[75957]: ts=2024-02-22T19:08:04.577Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-02-22T19:08:04.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:04 smithi063 bash[35391]: cluster 2024-02-22T19:08:03.477971+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:06.544 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:06 smithi062 bash[64101]: cluster 2024-02-22T19:08:05.478469+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:06.545 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:06 smithi062 bash[67442]: cluster 2024-02-22T19:08:05.478469+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:06.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:06 smithi063 bash[35391]: cluster 2024-02-22T19:08:05.478469+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:08.926 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:08 smithi062 bash[64101]: cluster 2024-02-22T19:08:07.478782+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:08.926 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:08 smithi062 bash[67442]: cluster 2024-02-22T19:08:07.478782+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:08.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:08 smithi063 bash[35391]: cluster 2024-02-22T19:08:07.478782+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:09.309 INFO:teuthology.orchestra.run.smithi062.stdout:42949672998 2024-02-22T19:08:09.309 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-22T19:08:09.535 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:09 smithi062 podman[76928]: Error: no container with ID or name "ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-alertmanager.a" found: no such container 2024-02-22T19:08:09.535 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:09 smithi062 systemd[1]: Started Ceph alertmanager.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:08:09.920 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:09 smithi062 bash[64101]: audit 2024-02-22T19:08:09.339283+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:53.496396\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:08:09.921 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:09 smithi062 bash[64101]: audit 2024-02-22T19:08:09.342951+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:53.496396\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:08:09.921 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:09 smithi062 bash[67442]: audit 2024-02-22T19:08:09.339283+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:53.496396\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:08:09.921 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:09 smithi062 bash[67442]: audit 2024-02-22T19:08:09.342951+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:53.496396\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:08:09.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:09 smithi063 bash[35391]: audit 2024-02-22T19:08:09.339283+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:53.496396\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:08:09.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:09 smithi063 bash[35391]: audit 2024-02-22T19:08:09.342951+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655526\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655603\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655647\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655683\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655714\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655743\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:06:07.655772\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:53.496396\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:08:10.484 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:10 smithi062 bash[76945]: ts=2024-02-22T19:08:10.053Z caller=main.go:245 level=info msg="Starting Alertmanager" version="(version=0.26.0, branch=HEAD, revision=d7b4f0c7322e7151d6e3b1e31cbc15361e295d8d)" 2024-02-22T19:08:10.485 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:10 smithi062 bash[76945]: ts=2024-02-22T19:08:10.053Z caller=main.go:246 level=info build_context="(go=go1.20.7, platform=linux/amd64, user=root@df8d7debeef4, date=20230824-11:11:58, tags=netgo)" 2024-02-22T19:08:10.485 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:10 smithi062 bash[76945]: ts=2024-02-22T19:08:10.054Z caller=cluster.go:186 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.62 port=9094 2024-02-22T19:08:10.485 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:10 smithi062 bash[76945]: ts=2024-02-22T19:08:10.055Z caller=cluster.go:683 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-22T19:08:10.485 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:10 smithi062 bash[76945]: ts=2024-02-22T19:08:10.077Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-22T19:08:10.485 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:10 smithi062 bash[76945]: ts=2024-02-22T19:08:10.077Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-22T19:08:10.485 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:10 smithi062 bash[76945]: ts=2024-02-22T19:08:10.080Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9093 2024-02-22T19:08:10.485 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:10 smithi062 bash[76945]: ts=2024-02-22T19:08:10.080Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-02-22T19:08:10.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:10 smithi063 bash[35391]: cluster 2024-02-22T19:08:09.479263+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:10.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:10 smithi063 bash[35391]: audit 2024-02-22T19:08:09.560761+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEA6imNEjVkldvQ1hhCIYvdIwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yNDAyMjIxOTA4MDlaFw0z\nNDAyMTkxOTA4MDlaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCjtEEGta92ffM0MUH6gqfL\n7wfi21WTqlkvZhZvco/HwQy5aHMNZZFDK7xkV0GbvSOEf5cdY2+Ciw2yCywfUlao\nBRXUa/NzKc//n6KcKfqpKqu/gGUPR8DSY+AO5M8AM7CKL/a3FwSL6qHvpKoAyWnK\n+LTLEO6ymP2lDtMYdmtCvCYa1TxTvtehHs2oTdTHWOFPB7o+KXyRuZRjb9eTZ10h\nm0/XmJXXggq8NUBs0e35a8HWiSP0Q9kuf74L3mAmySW9V2IuVafV0cla9FaICn/2\nFD58OKyjISiKZtWd3f87UrxkSY5XWl5OMXTpQj54wa4vIpk/QM5QHiQbpC1JCZ1N\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAD5G15UXTWsZ16m5Jr5Lp9EfRDdESvS+\nhIWsTAgPSKs6PiUWd/AfTr+qgF5q4LnNENL4MCeZT+nMZm3iQHUwcyLCWQHR4mYm\nIk9EngyTYceCK13rX2y+NDz7gi6m+j4yDZxxEO0yVwjphUFGdimWtfQLrLtUD9k2\nV1gAtfJg0t/zN7LB+hrh2zyCBvzwS3gcSAD96KXKmRCogZ3cTTlxU2jZzAbretg1\n39RKBLcP78UNcsjZzXhKkzGyadOpX7XIt3RsKRQyxehdjTHCXrViyWElBiyqRoZ2\nlb5IPOmHLtElAWv+UdI++BjbDftfKKSd6EB7tvzZvgDx5nzNFqiUQXE=\n-----END CERTIFICATE-----\n"}]: dispatch 2024-02-22T19:08:10.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:10 smithi063 bash[35391]: audit 2024-02-22T19:08:09.563129+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEA6imNEjVkldvQ1hhCIYvdIwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yNDAyMjIxOTA4MDlaFw0z\nNDAyMTkxOTA4MDlaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCjtEEGta92ffM0MUH6gqfL\n7wfi21WTqlkvZhZvco/HwQy5aHMNZZFDK7xkV0GbvSOEf5cdY2+Ciw2yCywfUlao\nBRXUa/NzKc//n6KcKfqpKqu/gGUPR8DSY+AO5M8AM7CKL/a3FwSL6qHvpKoAyWnK\n+LTLEO6ymP2lDtMYdmtCvCYa1TxTvtehHs2oTdTHWOFPB7o+KXyRuZRjb9eTZ10h\nm0/XmJXXggq8NUBs0e35a8HWiSP0Q9kuf74L3mAmySW9V2IuVafV0cla9FaICn/2\nFD58OKyjISiKZtWd3f87UrxkSY5XWl5OMXTpQj54wa4vIpk/QM5QHiQbpC1JCZ1N\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAD5G15UXTWsZ16m5Jr5Lp9EfRDdESvS+\nhIWsTAgPSKs6PiUWd/AfTr+qgF5q4LnNENL4MCeZT+nMZm3iQHUwcyLCWQHR4mYm\nIk9EngyTYceCK13rX2y+NDz7gi6m+j4yDZxxEO0yVwjphUFGdimWtfQLrLtUD9k2\nV1gAtfJg0t/zN7LB+hrh2zyCBvzwS3gcSAD96KXKmRCogZ3cTTlxU2jZzAbretg1\n39RKBLcP78UNcsjZzXhKkzGyadOpX7XIt3RsKRQyxehdjTHCXrViyWElBiyqRoZ2\nlb5IPOmHLtElAWv+UdI++BjbDftfKKSd6EB7tvzZvgDx5nzNFqiUQXE=\n-----END CERTIFICATE-----\n"}]': finished 2024-02-22T19:08:10.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:10 smithi063 bash[35391]: audit 2024-02-22T19:08:09.563518+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQCjtEEGta92ffM0\nMUH6gqfL7wfi21WTqlkvZhZvco/HwQy5aHMNZZFDK7xkV0GbvSOEf5cdY2+Ciw2y\nCywfUlaoBRXUa/NzKc//n6KcKfqpKqu/gGUPR8DSY+AO5M8AM7CKL/a3FwSL6qHv\npKoAyWnK+LTLEO6ymP2lDtMYdmtCvCYa1TxTvtehHs2oTdTHWOFPB7o+KXyRuZRj\nb9eTZ10hm0/XmJXXggq8NUBs0e35a8HWiSP0Q9kuf74L3mAmySW9V2IuVafV0cla\n9FaICn/2FD58OKyjISiKZtWd3f87UrxkSY5XWl5OMXTpQj54wa4vIpk/QM5QHiQb\npC1JCZ1NAgMBAAECggEAfPeEUEfvuweo2aXklQSabS56ma4P5Nq8nFdVNxyAL9/q\nA7t9YLOxMVK4zOxjNC0taN8xj4ixvjjCarDmrL5hUoAXSwJhZP99PckyC/5r0Cm3\n1EeCXijLRJBjoVr/vkq3MLYuo1PZ76lclyDfehxHO1+iPAYgAYySzCbF9L2pYdYg\nXPdU61cly95sMjn+O0sTlWw9JycL9uRD0XPfTowZcZNRF8ja8oMHfIII7G8MVUqn\n8hvttelToVvnC2svCjI/oqqSyWsR3iD9wdcsTHulOUuDGlXC7GaWB/tqdaDPh1DS\nrJyPAHVgZlQbLxBHGLN9ZjUOPgAag/PdbrLb/JZ5IQKBgQDXHv/gpuf+Tz3knf5c\nh43JN+POvWygwc7hrwa9ngRMYQ+Rd+31ZXwYkrp18p8N4RkRGs9Dd+awv7/hDBzE\nAAb3NurIv2I9s7g+yAUHnWSHF6F/flnHR9h80/Bc3ikfYvhy5DTPqBup+Otz02N0\n/bsN4edN3c9x3XWZmT8RJ7xkxQKBgQDCz/jHXrEMdujOOUS6CuMDAXM7IdN0cX2z\nn0Nw92aoWynQyhSgn2QVgKvUkiLoA7JBPU95aLwaCO7jATqUUgWEgxt4uwGKjw61\niZTK2QaK0oWTH8guGsalDsUt+oKVWclFPZ/8hMgoq5r9iyfH2nx53TUMo/J2EY48\nzzh4cwSu6QKBgEU62bgPnsuN7uo7Glfm2+9syCiJd4MIvC6PKEkvqEx4VA1JnlAC\nF/zEg7NfoGZUEcAac6dP1/L70qF3R26gX52Bk++E//XBd8LklhHMSkTbiwK/w97J\nNVd+0XThnjRWooQ/AuvtOvHphMSiu/gzi9Y85DZ/8rm/PpBu7Af2VL/NAoGAHIG+\nT75FfiNwUa0Dp42sRmZR7Fc40BNDZ6NohQFO3lfouIq5lf9878CSZFq2DOltjipg\nlM2EqPKhskodvlJ6SDe/L11+Dj580oe9ZCl50ZqYvTyrWEPGyaRtqhq8PQqUbzNj\nU9pCR+FEntFcEtyf1l1OQ/lBo5FSFQflpYp/JvECgYEApd5TJHfjmysYqitdNjfH\nkaDgU0WMGa8Sy2h4lp1EmTVvTPI8PgznUK/xvHXDrDY7Eu82INSbPDEUS8C44lsH\nuxZgddN8l1+GL1smpFPpZGjCyRedJ4NLSLJqBbV8Mofm4/7Zjx6iFP8QaS4usDaV\nE6HUeCWB744hKiBlyvZV73k=\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-02-22T19:08:10.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:10 smithi063 bash[35391]: audit 2024-02-22T19:08:09.569148+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQCjtEEGta92ffM0\nMUH6gqfL7wfi21WTqlkvZhZvco/HwQy5aHMNZZFDK7xkV0GbvSOEf5cdY2+Ciw2y\nCywfUlaoBRXUa/NzKc//n6KcKfqpKqu/gGUPR8DSY+AO5M8AM7CKL/a3FwSL6qHv\npKoAyWnK+LTLEO6ymP2lDtMYdmtCvCYa1TxTvtehHs2oTdTHWOFPB7o+KXyRuZRj\nb9eTZ10hm0/XmJXXggq8NUBs0e35a8HWiSP0Q9kuf74L3mAmySW9V2IuVafV0cla\n9FaICn/2FD58OKyjISiKZtWd3f87UrxkSY5XWl5OMXTpQj54wa4vIpk/QM5QHiQb\npC1JCZ1NAgMBAAECggEAfPeEUEfvuweo2aXklQSabS56ma4P5Nq8nFdVNxyAL9/q\nA7t9YLOxMVK4zOxjNC0taN8xj4ixvjjCarDmrL5hUoAXSwJhZP99PckyC/5r0Cm3\n1EeCXijLRJBjoVr/vkq3MLYuo1PZ76lclyDfehxHO1+iPAYgAYySzCbF9L2pYdYg\nXPdU61cly95sMjn+O0sTlWw9JycL9uRD0XPfTowZcZNRF8ja8oMHfIII7G8MVUqn\n8hvttelToVvnC2svCjI/oqqSyWsR3iD9wdcsTHulOUuDGlXC7GaWB/tqdaDPh1DS\nrJyPAHVgZlQbLxBHGLN9ZjUOPgAag/PdbrLb/JZ5IQKBgQDXHv/gpuf+Tz3knf5c\nh43JN+POvWygwc7hrwa9ngRMYQ+Rd+31ZXwYkrp18p8N4RkRGs9Dd+awv7/hDBzE\nAAb3NurIv2I9s7g+yAUHnWSHF6F/flnHR9h80/Bc3ikfYvhy5DTPqBup+Otz02N0\n/bsN4edN3c9x3XWZmT8RJ7xkxQKBgQDCz/jHXrEMdujOOUS6CuMDAXM7IdN0cX2z\nn0Nw92aoWynQyhSgn2QVgKvUkiLoA7JBPU95aLwaCO7jATqUUgWEgxt4uwGKjw61\niZTK2QaK0oWTH8guGsalDsUt+oKVWclFPZ/8hMgoq5r9iyfH2nx53TUMo/J2EY48\nzzh4cwSu6QKBgEU62bgPnsuN7uo7Glfm2+9syCiJd4MIvC6PKEkvqEx4VA1JnlAC\nF/zEg7NfoGZUEcAac6dP1/L70qF3R26gX52Bk++E//XBd8LklhHMSkTbiwK/w97J\nNVd+0XThnjRWooQ/AuvtOvHphMSiu/gzi9Y85DZ/8rm/PpBu7Af2VL/NAoGAHIG+\nT75FfiNwUa0Dp42sRmZR7Fc40BNDZ6NohQFO3lfouIq5lf9878CSZFq2DOltjipg\nlM2EqPKhskodvlJ6SDe/L11+Dj580oe9ZCl50ZqYvTyrWEPGyaRtqhq8PQqUbzNj\nU9pCR+FEntFcEtyf1l1OQ/lBo5FSFQflpYp/JvECgYEApd5TJHfjmysYqitdNjfH\nkaDgU0WMGa8Sy2h4lp1EmTVvTPI8PgznUK/xvHXDrDY7Eu82INSbPDEUS8C44lsH\nuxZgddN8l1+GL1smpFPpZGjCyRedJ4NLSLJqBbV8Mofm4/7Zjx6iFP8QaS4usDaV\nE6HUeCWB744hKiBlyvZV73k=\n-----END PRIVATE KEY-----\n"}]': finished 2024-02-22T19:08:10.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:10 smithi063 bash[35391]: cephadm 2024-02-22T19:08:09.569728+0000 mgr.y (mgr.14140) 184 : cephadm [INF] Deploying daemon grafana.a on smithi063 2024-02-22T19:08:10.972 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:10 smithi062 bash[64101]: cluster 2024-02-22T19:08:09.479263+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:10.972 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:10 smithi062 bash[64101]: audit 2024-02-22T19:08:09.560761+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEA6imNEjVkldvQ1hhCIYvdIwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yNDAyMjIxOTA4MDlaFw0z\nNDAyMTkxOTA4MDlaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCjtEEGta92ffM0MUH6gqfL\n7wfi21WTqlkvZhZvco/HwQy5aHMNZZFDK7xkV0GbvSOEf5cdY2+Ciw2yCywfUlao\nBRXUa/NzKc//n6KcKfqpKqu/gGUPR8DSY+AO5M8AM7CKL/a3FwSL6qHvpKoAyWnK\n+LTLEO6ymP2lDtMYdmtCvCYa1TxTvtehHs2oTdTHWOFPB7o+KXyRuZRjb9eTZ10h\nm0/XmJXXggq8NUBs0e35a8HWiSP0Q9kuf74L3mAmySW9V2IuVafV0cla9FaICn/2\nFD58OKyjISiKZtWd3f87UrxkSY5XWl5OMXTpQj54wa4vIpk/QM5QHiQbpC1JCZ1N\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAD5G15UXTWsZ16m5Jr5Lp9EfRDdESvS+\nhIWsTAgPSKs6PiUWd/AfTr+qgF5q4LnNENL4MCeZT+nMZm3iQHUwcyLCWQHR4mYm\nIk9EngyTYceCK13rX2y+NDz7gi6m+j4yDZxxEO0yVwjphUFGdimWtfQLrLtUD9k2\nV1gAtfJg0t/zN7LB+hrh2zyCBvzwS3gcSAD96KXKmRCogZ3cTTlxU2jZzAbretg1\n39RKBLcP78UNcsjZzXhKkzGyadOpX7XIt3RsKRQyxehdjTHCXrViyWElBiyqRoZ2\nlb5IPOmHLtElAWv+UdI++BjbDftfKKSd6EB7tvzZvgDx5nzNFqiUQXE=\n-----END CERTIFICATE-----\n"}]: dispatch 2024-02-22T19:08:10.972 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:10 smithi062 bash[64101]: audit 2024-02-22T19:08:09.563129+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEA6imNEjVkldvQ1hhCIYvdIwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yNDAyMjIxOTA4MDlaFw0z\nNDAyMTkxOTA4MDlaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCjtEEGta92ffM0MUH6gqfL\n7wfi21WTqlkvZhZvco/HwQy5aHMNZZFDK7xkV0GbvSOEf5cdY2+Ciw2yCywfUlao\nBRXUa/NzKc//n6KcKfqpKqu/gGUPR8DSY+AO5M8AM7CKL/a3FwSL6qHvpKoAyWnK\n+LTLEO6ymP2lDtMYdmtCvCYa1TxTvtehHs2oTdTHWOFPB7o+KXyRuZRjb9eTZ10h\nm0/XmJXXggq8NUBs0e35a8HWiSP0Q9kuf74L3mAmySW9V2IuVafV0cla9FaICn/2\nFD58OKyjISiKZtWd3f87UrxkSY5XWl5OMXTpQj54wa4vIpk/QM5QHiQbpC1JCZ1N\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAD5G15UXTWsZ16m5Jr5Lp9EfRDdESvS+\nhIWsTAgPSKs6PiUWd/AfTr+qgF5q4LnNENL4MCeZT+nMZm3iQHUwcyLCWQHR4mYm\nIk9EngyTYceCK13rX2y+NDz7gi6m+j4yDZxxEO0yVwjphUFGdimWtfQLrLtUD9k2\nV1gAtfJg0t/zN7LB+hrh2zyCBvzwS3gcSAD96KXKmRCogZ3cTTlxU2jZzAbretg1\n39RKBLcP78UNcsjZzXhKkzGyadOpX7XIt3RsKRQyxehdjTHCXrViyWElBiyqRoZ2\nlb5IPOmHLtElAWv+UdI++BjbDftfKKSd6EB7tvzZvgDx5nzNFqiUQXE=\n-----END CERTIFICATE-----\n"}]': finished 2024-02-22T19:08:10.972 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:10 smithi062 bash[64101]: audit 2024-02-22T19:08:09.563518+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQCjtEEGta92ffM0\nMUH6gqfL7wfi21WTqlkvZhZvco/HwQy5aHMNZZFDK7xkV0GbvSOEf5cdY2+Ciw2y\nCywfUlaoBRXUa/NzKc//n6KcKfqpKqu/gGUPR8DSY+AO5M8AM7CKL/a3FwSL6qHv\npKoAyWnK+LTLEO6ymP2lDtMYdmtCvCYa1TxTvtehHs2oTdTHWOFPB7o+KXyRuZRj\nb9eTZ10hm0/XmJXXggq8NUBs0e35a8HWiSP0Q9kuf74L3mAmySW9V2IuVafV0cla\n9FaICn/2FD58OKyjISiKZtWd3f87UrxkSY5XWl5OMXTpQj54wa4vIpk/QM5QHiQb\npC1JCZ1NAgMBAAECggEAfPeEUEfvuweo2aXklQSabS56ma4P5Nq8nFdVNxyAL9/q\nA7t9YLOxMVK4zOxjNC0taN8xj4ixvjjCarDmrL5hUoAXSwJhZP99PckyC/5r0Cm3\n1EeCXijLRJBjoVr/vkq3MLYuo1PZ76lclyDfehxHO1+iPAYgAYySzCbF9L2pYdYg\nXPdU61cly95sMjn+O0sTlWw9JycL9uRD0XPfTowZcZNRF8ja8oMHfIII7G8MVUqn\n8hvttelToVvnC2svCjI/oqqSyWsR3iD9wdcsTHulOUuDGlXC7GaWB/tqdaDPh1DS\nrJyPAHVgZlQbLxBHGLN9ZjUOPgAag/PdbrLb/JZ5IQKBgQDXHv/gpuf+Tz3knf5c\nh43JN+POvWygwc7hrwa9ngRMYQ+Rd+31ZXwYkrp18p8N4RkRGs9Dd+awv7/hDBzE\nAAb3NurIv2I9s7g+yAUHnWSHF6F/flnHR9h80/Bc3ikfYvhy5DTPqBup+Otz02N0\n/bsN4edN3c9x3XWZmT8RJ7xkxQKBgQDCz/jHXrEMdujOOUS6CuMDAXM7IdN0cX2z\nn0Nw92aoWynQyhSgn2QVgKvUkiLoA7JBPU95aLwaCO7jATqUUgWEgxt4uwGKjw61\niZTK2QaK0oWTH8guGsalDsUt+oKVWclFPZ/8hMgoq5r9iyfH2nx53TUMo/J2EY48\nzzh4cwSu6QKBgEU62bgPnsuN7uo7Glfm2+9syCiJd4MIvC6PKEkvqEx4VA1JnlAC\nF/zEg7NfoGZUEcAac6dP1/L70qF3R26gX52Bk++E//XBd8LklhHMSkTbiwK/w97J\nNVd+0XThnjRWooQ/AuvtOvHphMSiu/gzi9Y85DZ/8rm/PpBu7Af2VL/NAoGAHIG+\nT75FfiNwUa0Dp42sRmZR7Fc40BNDZ6NohQFO3lfouIq5lf9878CSZFq2DOltjipg\nlM2EqPKhskodvlJ6SDe/L11+Dj580oe9ZCl50ZqYvTyrWEPGyaRtqhq8PQqUbzNj\nU9pCR+FEntFcEtyf1l1OQ/lBo5FSFQflpYp/JvECgYEApd5TJHfjmysYqitdNjfH\nkaDgU0WMGa8Sy2h4lp1EmTVvTPI8PgznUK/xvHXDrDY7Eu82INSbPDEUS8C44lsH\nuxZgddN8l1+GL1smpFPpZGjCyRedJ4NLSLJqBbV8Mofm4/7Zjx6iFP8QaS4usDaV\nE6HUeCWB744hKiBlyvZV73k=\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-02-22T19:08:10.972 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:10 smithi062 bash[64101]: audit 2024-02-22T19:08:09.569148+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQCjtEEGta92ffM0\nMUH6gqfL7wfi21WTqlkvZhZvco/HwQy5aHMNZZFDK7xkV0GbvSOEf5cdY2+Ciw2y\nCywfUlaoBRXUa/NzKc//n6KcKfqpKqu/gGUPR8DSY+AO5M8AM7CKL/a3FwSL6qHv\npKoAyWnK+LTLEO6ymP2lDtMYdmtCvCYa1TxTvtehHs2oTdTHWOFPB7o+KXyRuZRj\nb9eTZ10hm0/XmJXXggq8NUBs0e35a8HWiSP0Q9kuf74L3mAmySW9V2IuVafV0cla\n9FaICn/2FD58OKyjISiKZtWd3f87UrxkSY5XWl5OMXTpQj54wa4vIpk/QM5QHiQb\npC1JCZ1NAgMBAAECggEAfPeEUEfvuweo2aXklQSabS56ma4P5Nq8nFdVNxyAL9/q\nA7t9YLOxMVK4zOxjNC0taN8xj4ixvjjCarDmrL5hUoAXSwJhZP99PckyC/5r0Cm3\n1EeCXijLRJBjoVr/vkq3MLYuo1PZ76lclyDfehxHO1+iPAYgAYySzCbF9L2pYdYg\nXPdU61cly95sMjn+O0sTlWw9JycL9uRD0XPfTowZcZNRF8ja8oMHfIII7G8MVUqn\n8hvttelToVvnC2svCjI/oqqSyWsR3iD9wdcsTHulOUuDGlXC7GaWB/tqdaDPh1DS\nrJyPAHVgZlQbLxBHGLN9ZjUOPgAag/PdbrLb/JZ5IQKBgQDXHv/gpuf+Tz3knf5c\nh43JN+POvWygwc7hrwa9ngRMYQ+Rd+31ZXwYkrp18p8N4RkRGs9Dd+awv7/hDBzE\nAAb3NurIv2I9s7g+yAUHnWSHF6F/flnHR9h80/Bc3ikfYvhy5DTPqBup+Otz02N0\n/bsN4edN3c9x3XWZmT8RJ7xkxQKBgQDCz/jHXrEMdujOOUS6CuMDAXM7IdN0cX2z\nn0Nw92aoWynQyhSgn2QVgKvUkiLoA7JBPU95aLwaCO7jATqUUgWEgxt4uwGKjw61\niZTK2QaK0oWTH8guGsalDsUt+oKVWclFPZ/8hMgoq5r9iyfH2nx53TUMo/J2EY48\nzzh4cwSu6QKBgEU62bgPnsuN7uo7Glfm2+9syCiJd4MIvC6PKEkvqEx4VA1JnlAC\nF/zEg7NfoGZUEcAac6dP1/L70qF3R26gX52Bk++E//XBd8LklhHMSkTbiwK/w97J\nNVd+0XThnjRWooQ/AuvtOvHphMSiu/gzi9Y85DZ/8rm/PpBu7Af2VL/NAoGAHIG+\nT75FfiNwUa0Dp42sRmZR7Fc40BNDZ6NohQFO3lfouIq5lf9878CSZFq2DOltjipg\nlM2EqPKhskodvlJ6SDe/L11+Dj580oe9ZCl50ZqYvTyrWEPGyaRtqhq8PQqUbzNj\nU9pCR+FEntFcEtyf1l1OQ/lBo5FSFQflpYp/JvECgYEApd5TJHfjmysYqitdNjfH\nkaDgU0WMGa8Sy2h4lp1EmTVvTPI8PgznUK/xvHXDrDY7Eu82INSbPDEUS8C44lsH\nuxZgddN8l1+GL1smpFPpZGjCyRedJ4NLSLJqBbV8Mofm4/7Zjx6iFP8QaS4usDaV\nE6HUeCWB744hKiBlyvZV73k=\n-----END PRIVATE KEY-----\n"}]': finished 2024-02-22T19:08:10.972 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:10 smithi062 bash[64101]: cephadm 2024-02-22T19:08:09.569728+0000 mgr.y (mgr.14140) 184 : cephadm [INF] Deploying daemon grafana.a on smithi063 2024-02-22T19:08:10.973 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:10 smithi062 bash[67442]: cluster 2024-02-22T19:08:09.479263+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:10.973 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:10 smithi062 bash[67442]: audit 2024-02-22T19:08:09.560761+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEA6imNEjVkldvQ1hhCIYvdIwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yNDAyMjIxOTA4MDlaFw0z\nNDAyMTkxOTA4MDlaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCjtEEGta92ffM0MUH6gqfL\n7wfi21WTqlkvZhZvco/HwQy5aHMNZZFDK7xkV0GbvSOEf5cdY2+Ciw2yCywfUlao\nBRXUa/NzKc//n6KcKfqpKqu/gGUPR8DSY+AO5M8AM7CKL/a3FwSL6qHvpKoAyWnK\n+LTLEO6ymP2lDtMYdmtCvCYa1TxTvtehHs2oTdTHWOFPB7o+KXyRuZRjb9eTZ10h\nm0/XmJXXggq8NUBs0e35a8HWiSP0Q9kuf74L3mAmySW9V2IuVafV0cla9FaICn/2\nFD58OKyjISiKZtWd3f87UrxkSY5XWl5OMXTpQj54wa4vIpk/QM5QHiQbpC1JCZ1N\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAD5G15UXTWsZ16m5Jr5Lp9EfRDdESvS+\nhIWsTAgPSKs6PiUWd/AfTr+qgF5q4LnNENL4MCeZT+nMZm3iQHUwcyLCWQHR4mYm\nIk9EngyTYceCK13rX2y+NDz7gi6m+j4yDZxxEO0yVwjphUFGdimWtfQLrLtUD9k2\nV1gAtfJg0t/zN7LB+hrh2zyCBvzwS3gcSAD96KXKmRCogZ3cTTlxU2jZzAbretg1\n39RKBLcP78UNcsjZzXhKkzGyadOpX7XIt3RsKRQyxehdjTHCXrViyWElBiyqRoZ2\nlb5IPOmHLtElAWv+UdI++BjbDftfKKSd6EB7tvzZvgDx5nzNFqiUQXE=\n-----END CERTIFICATE-----\n"}]: dispatch 2024-02-22T19:08:10.973 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:10 smithi062 bash[67442]: audit 2024-02-22T19:08:09.563129+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxTCCAa0CEA6imNEjVkldvQ1hhCIYvdIwDQYJKoZIhvcNAQENBQAwITENMAsG\nA1UECgwEQ2VwaDEQMA4GA1UEAwwHY2VwaGFkbTAeFw0yNDAyMjIxOTA4MDlaFw0z\nNDAyMTkxOTA4MDlaMCExDTALBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0w\nggEiMA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQCjtEEGta92ffM0MUH6gqfL\n7wfi21WTqlkvZhZvco/HwQy5aHMNZZFDK7xkV0GbvSOEf5cdY2+Ciw2yCywfUlao\nBRXUa/NzKc//n6KcKfqpKqu/gGUPR8DSY+AO5M8AM7CKL/a3FwSL6qHvpKoAyWnK\n+LTLEO6ymP2lDtMYdmtCvCYa1TxTvtehHs2oTdTHWOFPB7o+KXyRuZRjb9eTZ10h\nm0/XmJXXggq8NUBs0e35a8HWiSP0Q9kuf74L3mAmySW9V2IuVafV0cla9FaICn/2\nFD58OKyjISiKZtWd3f87UrxkSY5XWl5OMXTpQj54wa4vIpk/QM5QHiQbpC1JCZ1N\nAgMBAAEwDQYJKoZIhvcNAQENBQADggEBAD5G15UXTWsZ16m5Jr5Lp9EfRDdESvS+\nhIWsTAgPSKs6PiUWd/AfTr+qgF5q4LnNENL4MCeZT+nMZm3iQHUwcyLCWQHR4mYm\nIk9EngyTYceCK13rX2y+NDz7gi6m+j4yDZxxEO0yVwjphUFGdimWtfQLrLtUD9k2\nV1gAtfJg0t/zN7LB+hrh2zyCBvzwS3gcSAD96KXKmRCogZ3cTTlxU2jZzAbretg1\n39RKBLcP78UNcsjZzXhKkzGyadOpX7XIt3RsKRQyxehdjTHCXrViyWElBiyqRoZ2\nlb5IPOmHLtElAWv+UdI++BjbDftfKKSd6EB7tvzZvgDx5nzNFqiUQXE=\n-----END CERTIFICATE-----\n"}]': finished 2024-02-22T19:08:10.973 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:10 smithi062 bash[67442]: audit 2024-02-22T19:08:09.563518+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQCjtEEGta92ffM0\nMUH6gqfL7wfi21WTqlkvZhZvco/HwQy5aHMNZZFDK7xkV0GbvSOEf5cdY2+Ciw2y\nCywfUlaoBRXUa/NzKc//n6KcKfqpKqu/gGUPR8DSY+AO5M8AM7CKL/a3FwSL6qHv\npKoAyWnK+LTLEO6ymP2lDtMYdmtCvCYa1TxTvtehHs2oTdTHWOFPB7o+KXyRuZRj\nb9eTZ10hm0/XmJXXggq8NUBs0e35a8HWiSP0Q9kuf74L3mAmySW9V2IuVafV0cla\n9FaICn/2FD58OKyjISiKZtWd3f87UrxkSY5XWl5OMXTpQj54wa4vIpk/QM5QHiQb\npC1JCZ1NAgMBAAECggEAfPeEUEfvuweo2aXklQSabS56ma4P5Nq8nFdVNxyAL9/q\nA7t9YLOxMVK4zOxjNC0taN8xj4ixvjjCarDmrL5hUoAXSwJhZP99PckyC/5r0Cm3\n1EeCXijLRJBjoVr/vkq3MLYuo1PZ76lclyDfehxHO1+iPAYgAYySzCbF9L2pYdYg\nXPdU61cly95sMjn+O0sTlWw9JycL9uRD0XPfTowZcZNRF8ja8oMHfIII7G8MVUqn\n8hvttelToVvnC2svCjI/oqqSyWsR3iD9wdcsTHulOUuDGlXC7GaWB/tqdaDPh1DS\nrJyPAHVgZlQbLxBHGLN9ZjUOPgAag/PdbrLb/JZ5IQKBgQDXHv/gpuf+Tz3knf5c\nh43JN+POvWygwc7hrwa9ngRMYQ+Rd+31ZXwYkrp18p8N4RkRGs9Dd+awv7/hDBzE\nAAb3NurIv2I9s7g+yAUHnWSHF6F/flnHR9h80/Bc3ikfYvhy5DTPqBup+Otz02N0\n/bsN4edN3c9x3XWZmT8RJ7xkxQKBgQDCz/jHXrEMdujOOUS6CuMDAXM7IdN0cX2z\nn0Nw92aoWynQyhSgn2QVgKvUkiLoA7JBPU95aLwaCO7jATqUUgWEgxt4uwGKjw61\niZTK2QaK0oWTH8guGsalDsUt+oKVWclFPZ/8hMgoq5r9iyfH2nx53TUMo/J2EY48\nzzh4cwSu6QKBgEU62bgPnsuN7uo7Glfm2+9syCiJd4MIvC6PKEkvqEx4VA1JnlAC\nF/zEg7NfoGZUEcAac6dP1/L70qF3R26gX52Bk++E//XBd8LklhHMSkTbiwK/w97J\nNVd+0XThnjRWooQ/AuvtOvHphMSiu/gzi9Y85DZ/8rm/PpBu7Af2VL/NAoGAHIG+\nT75FfiNwUa0Dp42sRmZR7Fc40BNDZ6NohQFO3lfouIq5lf9878CSZFq2DOltjipg\nlM2EqPKhskodvlJ6SDe/L11+Dj580oe9ZCl50ZqYvTyrWEPGyaRtqhq8PQqUbzNj\nU9pCR+FEntFcEtyf1l1OQ/lBo5FSFQflpYp/JvECgYEApd5TJHfjmysYqitdNjfH\nkaDgU0WMGa8Sy2h4lp1EmTVvTPI8PgznUK/xvHXDrDY7Eu82INSbPDEUS8C44lsH\nuxZgddN8l1+GL1smpFPpZGjCyRedJ4NLSLJqBbV8Mofm4/7Zjx6iFP8QaS4usDaV\nE6HUeCWB744hKiBlyvZV73k=\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-02-22T19:08:10.973 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:10 smithi062 bash[67442]: audit 2024-02-22T19:08:09.569148+0000 mon.a (mon.0) 495 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQCjtEEGta92ffM0\nMUH6gqfL7wfi21WTqlkvZhZvco/HwQy5aHMNZZFDK7xkV0GbvSOEf5cdY2+Ciw2y\nCywfUlaoBRXUa/NzKc//n6KcKfqpKqu/gGUPR8DSY+AO5M8AM7CKL/a3FwSL6qHv\npKoAyWnK+LTLEO6ymP2lDtMYdmtCvCYa1TxTvtehHs2oTdTHWOFPB7o+KXyRuZRj\nb9eTZ10hm0/XmJXXggq8NUBs0e35a8HWiSP0Q9kuf74L3mAmySW9V2IuVafV0cla\n9FaICn/2FD58OKyjISiKZtWd3f87UrxkSY5XWl5OMXTpQj54wa4vIpk/QM5QHiQb\npC1JCZ1NAgMBAAECggEAfPeEUEfvuweo2aXklQSabS56ma4P5Nq8nFdVNxyAL9/q\nA7t9YLOxMVK4zOxjNC0taN8xj4ixvjjCarDmrL5hUoAXSwJhZP99PckyC/5r0Cm3\n1EeCXijLRJBjoVr/vkq3MLYuo1PZ76lclyDfehxHO1+iPAYgAYySzCbF9L2pYdYg\nXPdU61cly95sMjn+O0sTlWw9JycL9uRD0XPfTowZcZNRF8ja8oMHfIII7G8MVUqn\n8hvttelToVvnC2svCjI/oqqSyWsR3iD9wdcsTHulOUuDGlXC7GaWB/tqdaDPh1DS\nrJyPAHVgZlQbLxBHGLN9ZjUOPgAag/PdbrLb/JZ5IQKBgQDXHv/gpuf+Tz3knf5c\nh43JN+POvWygwc7hrwa9ngRMYQ+Rd+31ZXwYkrp18p8N4RkRGs9Dd+awv7/hDBzE\nAAb3NurIv2I9s7g+yAUHnWSHF6F/flnHR9h80/Bc3ikfYvhy5DTPqBup+Otz02N0\n/bsN4edN3c9x3XWZmT8RJ7xkxQKBgQDCz/jHXrEMdujOOUS6CuMDAXM7IdN0cX2z\nn0Nw92aoWynQyhSgn2QVgKvUkiLoA7JBPU95aLwaCO7jATqUUgWEgxt4uwGKjw61\niZTK2QaK0oWTH8guGsalDsUt+oKVWclFPZ/8hMgoq5r9iyfH2nx53TUMo/J2EY48\nzzh4cwSu6QKBgEU62bgPnsuN7uo7Glfm2+9syCiJd4MIvC6PKEkvqEx4VA1JnlAC\nF/zEg7NfoGZUEcAac6dP1/L70qF3R26gX52Bk++E//XBd8LklhHMSkTbiwK/w97J\nNVd+0XThnjRWooQ/AuvtOvHphMSiu/gzi9Y85DZ/8rm/PpBu7Af2VL/NAoGAHIG+\nT75FfiNwUa0Dp42sRmZR7Fc40BNDZ6NohQFO3lfouIq5lf9878CSZFq2DOltjipg\nlM2EqPKhskodvlJ6SDe/L11+Dj580oe9ZCl50ZqYvTyrWEPGyaRtqhq8PQqUbzNj\nU9pCR+FEntFcEtyf1l1OQ/lBo5FSFQflpYp/JvECgYEApd5TJHfjmysYqitdNjfH\nkaDgU0WMGa8Sy2h4lp1EmTVvTPI8PgznUK/xvHXDrDY7Eu82INSbPDEUS8C44lsH\nuxZgddN8l1+GL1smpFPpZGjCyRedJ4NLSLJqBbV8Mofm4/7Zjx6iFP8QaS4usDaV\nE6HUeCWB744hKiBlyvZV73k=\n-----END PRIVATE KEY-----\n"}]': finished 2024-02-22T19:08:10.973 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:10 smithi062 bash[67442]: cephadm 2024-02-22T19:08:09.569728+0000 mgr.y (mgr.14140) 184 : cephadm [INF] Deploying daemon grafana.a on smithi063 2024-02-22T19:08:12.064 INFO:teuthology.orchestra.run.smithi062.stdout:68719476771 2024-02-22T19:08:12.065 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-22T19:08:12.093 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:12 smithi062 bash[76945]: ts=2024-02-22T19:08:12.055Z caller=cluster.go:708 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000574484s 2024-02-22T19:08:12.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:12 smithi062 bash[64101]: cluster 2024-02-22T19:08:11.479601+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:12.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:12 smithi062 bash[67442]: cluster 2024-02-22T19:08:11.479601+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:12.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:12 smithi063 bash[35391]: cluster 2024-02-22T19:08:11.479601+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:14.569 INFO:teuthology.orchestra.run.smithi062.stdout:90194313248 2024-02-22T19:08:14.569 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-22T19:08:14.962 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:14 smithi062 bash[64101]: cluster 2024-02-22T19:08:13.479958+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:14.963 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:14 smithi062 bash[67442]: cluster 2024-02-22T19:08:13.479958+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:14.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:14 smithi063 bash[35391]: cluster 2024-02-22T19:08:13.479958+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:16.639 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:16 smithi062 bash[64101]: cluster 2024-02-22T19:08:15.480294+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:16.640 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:16 smithi062 bash[67442]: cluster 2024-02-22T19:08:15.480294+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:16.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:16 smithi063 bash[35391]: cluster 2024-02-22T19:08:15.480294+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:16.965 INFO:teuthology.orchestra.run.smithi062.stdout:111669149723 2024-02-22T19:08:16.966 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-22T19:08:18.626 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:18 smithi062 bash[64101]: cluster 2024-02-22T19:08:17.480646+0000 mgr.y (mgr.14140) 188 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:18.626 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:18 smithi062 bash[67442]: cluster 2024-02-22T19:08:17.480646+0000 mgr.y (mgr.14140) 188 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:18.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:18 smithi063 bash[35391]: cluster 2024-02-22T19:08:17.480646+0000 mgr.y (mgr.14140) 188 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:19.647 INFO:teuthology.orchestra.run.smithi062.stdout:133143986200 2024-02-22T19:08:19.648 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-22T19:08:20.484 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:20 smithi062 bash[76945]: ts=2024-02-22T19:08:20.058Z caller=cluster.go:700 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.002710988s 2024-02-22T19:08:20.898 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:20 smithi062 bash[64101]: cluster 2024-02-22T19:08:19.481043+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:20.898 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:20 smithi062 bash[67442]: cluster 2024-02-22T19:08:19.481043+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:20.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:20 smithi063 bash[35391]: cluster 2024-02-22T19:08:19.481043+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:22.073 INFO:teuthology.orchestra.run.smithi062.stdout:154618822677 2024-02-22T19:08:22.073 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-02-22T19:08:22.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:22 smithi062 bash[64101]: cluster 2024-02-22T19:08:21.481318+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:22.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:22 smithi062 bash[67442]: cluster 2024-02-22T19:08:21.481318+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:22.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:22 smithi063 bash[35391]: cluster 2024-02-22T19:08:21.481318+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:24.597 INFO:teuthology.orchestra.run.smithi062.stdout:176093659153 2024-02-22T19:08:24.598 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-02-22T19:08:24.922 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:24 smithi062 bash[64101]: cluster 2024-02-22T19:08:23.481781+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:24.922 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:24 smithi062 bash[67442]: cluster 2024-02-22T19:08:23.481781+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:24.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:24 smithi063 bash[35391]: cluster 2024-02-22T19:08:23.481781+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:26.649 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:26 smithi062 bash[64101]: cluster 2024-02-22T19:08:25.482079+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:26.649 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:26 smithi062 bash[67442]: cluster 2024-02-22T19:08:25.482079+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:26.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:26 smithi063 bash[35391]: cluster 2024-02-22T19:08:25.482079+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:26.991 INFO:teuthology.orchestra.run.smithi062.stdout:197568495630 2024-02-22T19:08:26.991 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-22T19:08:28.884 INFO:teuthology.orchestra.run.smithi062.stdout:42949673002 2024-02-22T19:08:28.913 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:28 smithi062 bash[64101]: cluster 2024-02-22T19:08:27.482512+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:28.913 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:28 smithi062 bash[67442]: cluster 2024-02-22T19:08:27.482512+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:28.914 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:28 smithi063 bash[35391]: cluster 2024-02-22T19:08:27.482512+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:29.541 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 podman[44856]: Error: no container with ID or name "ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-grafana.a" found: no such container 2024-02-22T19:08:29.541 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 systemd[1]: Started Ceph grafana.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:08:29.621 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949672998 got 42949673002 for osd.0 2024-02-22T19:08:29.621 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-22T19:08:29.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:29 smithi062 bash[64101]: audit 2024-02-22T19:08:28.884124+0000 mon.c (mon.1) 12 : audit [DBG] from='client.? 172.21.15.62:0/3111125981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-22T19:08:29.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:29 smithi062 bash[67442]: audit 2024-02-22T19:08:28.884124+0000 mon.c (mon.1) 12 : audit [DBG] from='client.? 172.21.15.62:0/3111125981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-22T19:08:29.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:29 smithi062 bash[64101]: audit 2024-02-22T19:08:29.280896+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.155996\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156072\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156106\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156138\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156169\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156199\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156229\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:08:29.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:29 smithi062 bash[64101]: audit 2024-02-22T19:08:29.283823+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.155996\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156072\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156106\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156138\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156169\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156199\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156229\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:08:29.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:29 smithi062 bash[64101]: audit 2024-02-22T19:08:29.284479+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:08:29.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:29 smithi062 bash[67442]: audit 2024-02-22T19:08:29.280896+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.155996\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156072\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156106\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156138\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156169\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156199\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156229\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:08:29.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:29 smithi062 bash[67442]: audit 2024-02-22T19:08:29.283823+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.155996\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156072\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156106\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156138\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156169\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156199\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156229\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:08:29.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:29 smithi062 bash[67442]: audit 2024-02-22T19:08:29.284479+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:08:29.836 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[35391]: audit 2024-02-22T19:08:28.884124+0000 mon.c (mon.1) 12 : audit [DBG] from='client.? 172.21.15.62:0/3111125981' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-22T19:08:29.836 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[35391]: audit 2024-02-22T19:08:29.280896+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.155996\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156072\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156106\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156138\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156169\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156199\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156229\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:08:29.836 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[35391]: audit 2024-02-22T19:08:29.283823+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.155996\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156072\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156106\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156138\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156169\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156199\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:07:52.156229\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:08:29.836 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[35391]: audit 2024-02-22T19:08:29.284479+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:08:30.214 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Starting Grafana" logger=server version=6.6.2 commit=3fa63cfc34 branch=HEAD compiled=2020-02-20T12:03:49+0000 2024-02-22T19:08:30.214 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2024-02-22T19:08:30.214 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2024-02-22T19:08:30.214 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2024-02-22T19:08:30.215 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2024-02-22T19:08:30.215 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-02-22T19:08:30.215 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-02-22T19:08:30.215 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2024-02-22T19:08:30.215 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2024-02-22T19:08:30.215 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2024-02-22T19:08:30.215 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2024-02-22T19:08:30.215 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2024-02-22T19:08:30.215 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="App mode production" logger=settings 2024-02-22T19:08:30.215 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing SqlStore" logger=server 2024-02-22T19:08:30.215 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2024-02-22T19:08:30.215 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Starting DB migration" logger=migrator 2024-02-22T19:08:30.215 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2024-02-22T19:08:30.215 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2024-02-22T19:08:30.215 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2024-02-22T19:08:30.215 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2024-02-22T19:08:30.216 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2024-02-22T19:08:30.216 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2024-02-22T19:08:30.216 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2024-02-22T19:08:30.216 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2024-02-22T19:08:30.216 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2024-02-22T19:08:30.216 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2024-02-22T19:08:30.216 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-02-22T19:08:30.216 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2024-02-22T19:08:30.216 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2024-02-22T19:08:30.216 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2024-02-22T19:08:30.216 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2024-02-22T19:08:30.216 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2024-02-22T19:08:30.217 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2024-02-22T19:08:30.217 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2024-02-22T19:08:30.217 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2024-02-22T19:08:30.217 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2024-02-22T19:08:30.217 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2024-02-22T19:08:30.217 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2024-02-22T19:08:30.217 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2024-02-22T19:08:30.217 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2024-02-22T19:08:30.217 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2024-02-22T19:08:30.217 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2024-02-22T19:08:30.217 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2024-02-22T19:08:30.217 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2024-02-22T19:08:30.217 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2024-02-22T19:08:30.217 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2024-02-22T19:08:30.217 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2024-02-22T19:08:30.217 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2024-02-22T19:08:30.218 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2024-02-22T19:08:30.218 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2024-02-22T19:08:30.218 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2024-02-22T19:08:30.218 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2024-02-22T19:08:30.218 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2024-02-22T19:08:30.218 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2024-02-22T19:08:30.218 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-02-22T19:08:30.218 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2024-02-22T19:08:30.218 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2024-02-22T19:08:30.218 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2024-02-22T19:08:30.218 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2024-02-22T19:08:30.218 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2024-02-22T19:08:30.218 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2024-02-22T19:08:30.218 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2024-02-22T19:08:30.219 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2024-02-22T19:08:30.219 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2024-02-22T19:08:30.219 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2024-02-22T19:08:30.219 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2024-02-22T19:08:30.219 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2024-02-22T19:08:30.219 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2024-02-22T19:08:30.219 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2024-02-22T19:08:30.219 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2024-02-22T19:08:30.219 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2024-02-22T19:08:30.219 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2024-02-22T19:08:30.219 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2024-02-22T19:08:30.219 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2024-02-22T19:08:30.219 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2024-02-22T19:08:30.219 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2024-02-22T19:08:30.219 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2024-02-22T19:08:30.219 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2024-02-22T19:08:30.220 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2024-02-22T19:08:30.220 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2024-02-22T19:08:30.220 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2024-02-22T19:08:30.220 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-02-22T19:08:30.220 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2024-02-22T19:08:30.220 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-02-22T19:08:30.220 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-02-22T19:08:30.220 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2024-02-22T19:08:30.220 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2024-02-22T19:08:30.220 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2024-02-22T19:08:30.220 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2024-02-22T19:08:30.220 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2024-02-22T19:08:30.220 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2024-02-22T19:08:30.221 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2024-02-22T19:08:30.221 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2024-02-22T19:08:30.221 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2024-02-22T19:08:30.221 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2024-02-22T19:08:30.221 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2024-02-22T19:08:30.221 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2024-02-22T19:08:30.221 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-02-22T19:08:30.221 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2024-02-22T19:08:30.221 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2024-02-22T19:08:30.221 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2024-02-22T19:08:30.221 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2024-02-22T19:08:30.221 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2024-02-22T19:08:30.221 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2024-02-22T19:08:30.221 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2024-02-22T19:08:30.221 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2024-02-22T19:08:30.222 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2024-02-22T19:08:30.222 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2024-02-22T19:08:30.222 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2024-02-22T19:08:30.222 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2024-02-22T19:08:30.222 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2024-02-22T19:08:30.222 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2024-02-22T19:08:30.222 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2024-02-22T19:08:30.222 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2024-02-22T19:08:30.222 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2024-02-22T19:08:30.222 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2024-02-22T19:08:30.222 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2024-02-22T19:08:30.222 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2024-02-22T19:08:30.222 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2024-02-22T19:08:30.222 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2024-02-22T19:08:30.222 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2024-02-22T19:08:30.223 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2024-02-22T19:08:30.223 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2024-02-22T19:08:30.223 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2024-02-22T19:08:30.223 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2024-02-22T19:08:30.223 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2024-02-22T19:08:30.223 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-02-22T19:08:30.223 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2024-02-22T19:08:30.223 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2024-02-22T19:08:30.223 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2024-02-22T19:08:30.223 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2024-02-22T19:08:30.223 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2024-02-22T19:08:30.223 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2024-02-22T19:08:30.223 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2024-02-22T19:08:30.223 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2024-02-22T19:08:30.223 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-02-22T19:08:30.223 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2024-02-22T19:08:30.224 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2024-02-22T19:08:30.224 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2024-02-22T19:08:30.224 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2024-02-22T19:08:30.224 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2024-02-22T19:08:30.224 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2024-02-22T19:08:30.224 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2024-02-22T19:08:30.224 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2024-02-22T19:08:30.224 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2024-02-22T19:08:30.224 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2024-02-22T19:08:30.224 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2024-02-22T19:08:30.224 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2024-02-22T19:08:30.224 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2024-02-22T19:08:30.224 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2024-02-22T19:08:30.224 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2024-02-22T19:08:30.224 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2024-02-22T19:08:30.225 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2024-02-22T19:08:30.225 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2024-02-22T19:08:30.225 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2024-02-22T19:08:30.225 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2024-02-22T19:08:30.225 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-02-22T19:08:30.226 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2024-02-22T19:08:30.226 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2024-02-22T19:08:30.226 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2024-02-22T19:08:30.226 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2024-02-22T19:08:30.226 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2024-02-22T19:08:30.226 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2024-02-22T19:08:30.226 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2024-02-22T19:08:30.226 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2024-02-22T19:08:30.226 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2024-02-22T19:08:30.226 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2024-02-22T19:08:30.226 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2024-02-22T19:08:30.226 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2024-02-22T19:08:30.226 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-02-22T19:08:30.227 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2024-02-22T19:08:30.227 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2024-02-22T19:08:30.227 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2024-02-22T19:08:30.227 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2024-02-22T19:08:30.227 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2024-02-22T19:08:30.227 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2024-02-22T19:08:30.227 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2024-02-22T19:08:30.227 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2024-02-22T19:08:30.227 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2024-02-22T19:08:30.227 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2024-02-22T19:08:30.227 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2024-02-22T19:08:30.227 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2024-02-22T19:08:30.227 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2024-02-22T19:08:30.227 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2024-02-22T19:08:30.227 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2024-02-22T19:08:30.228 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2024-02-22T19:08:30.228 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2024-02-22T19:08:30.228 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2024-02-22T19:08:30.228 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2024-02-22T19:08:30.228 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2024-02-22T19:08:30.228 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2024-02-22T19:08:30.228 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2024-02-22T19:08:30.228 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2024-02-22T19:08:30.228 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2024-02-22T19:08:30.228 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2024-02-22T19:08:30.228 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2024-02-22T19:08:30.228 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2024-02-22T19:08:30.229 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2024-02-22T19:08:30.229 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2024-02-22T19:08:30.229 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-02-22T19:08:30.229 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-02-22T19:08:30.229 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2024-02-22T19:08:30.229 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2024-02-22T19:08:30.229 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2024-02-22T19:08:30.229 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2024-02-22T19:08:30.229 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2024-02-22T19:08:30.229 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-02-22T19:08:30.229 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2024-02-22T19:08:30.229 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2024-02-22T19:08:30.229 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2024-02-22T19:08:30.229 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2024-02-22T19:08:30.229 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2024-02-22T19:08:30.230 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2024-02-22T19:08:30.230 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2024-02-22T19:08:30.230 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2024-02-22T19:08:30.230 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2024-02-22T19:08:30.230 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2024-02-22T19:08:30.230 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2024-02-22T19:08:30.230 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2024-02-22T19:08:30.230 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2024-02-22T19:08:30.230 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2024-02-22T19:08:30.230 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2024-02-22T19:08:30.230 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2024-02-22T19:08:30.230 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2024-02-22T19:08:30.230 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2024-02-22T19:08:30.230 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2024-02-22T19:08:30.230 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2024-02-22T19:08:30.230 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2024-02-22T19:08:30.231 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2024-02-22T19:08:30.231 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-02-22T19:08:30.231 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2024-02-22T19:08:30.231 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2024-02-22T19:08:30.231 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2024-02-22T19:08:30.231 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2024-02-22T19:08:30.231 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2024-02-22T19:08:30.231 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-02-22T19:08:30.231 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2024-02-22T19:08:30.231 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2024-02-22T19:08:30.231 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2024-02-22T19:08:30.231 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2024-02-22T19:08:30.231 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2024-02-22T19:08:30.231 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2024-02-22T19:08:30.231 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2024-02-22T19:08:30.231 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2024-02-22T19:08:30.232 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2024-02-22T19:08:30.232 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2024-02-22T19:08:30.232 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2024-02-22T19:08:30.232 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2024-02-22T19:08:30.232 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2024-02-22T19:08:30.232 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2024-02-22T19:08:30.232 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing HTTPServer" logger=server 2024-02-22T19:08:30.232 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2024-02-22T19:08:30.232 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing PluginManager" logger=server 2024-02-22T19:08:30.232 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Starting plugin search" logger=plugins 2024-02-22T19:08:30.232 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2024-02-22T19:08:30.232 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2024-02-22T19:08:30.232 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing HooksService" logger=server 2024-02-22T19:08:30.232 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2024-02-22T19:08:30.233 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2024-02-22T19:08:30.233 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing RemoteCache" logger=server 2024-02-22T19:08:30.233 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing QuotaService" logger=server 2024-02-22T19:08:30.233 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing ServerLockService" logger=server 2024-02-22T19:08:30.233 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2024-02-22T19:08:30.233 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing RenderingService" logger=server 2024-02-22T19:08:30.233 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing AlertEngine" logger=server 2024-02-22T19:08:30.233 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2024-02-22T19:08:30.233 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing LoginService" logger=server 2024-02-22T19:08:30.233 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing SearchService" logger=server 2024-02-22T19:08:30.233 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing TracingService" logger=server 2024-02-22T19:08:30.233 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2024-02-22T19:08:30.233 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing CleanUpService" logger=server 2024-02-22T19:08:30.233 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing NotificationService" logger=server 2024-02-22T19:08:30.233 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2024-02-22T19:08:30.233 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2024-02-22T19:08:30.234 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name="Dashboard 1" 2024-02-22T19:08:30.234 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2024-02-22T19:08:30.234 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin." logger=rendering renderer=phantomJS 2024-02-22T19:08:30.234 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="Initializing Stream Manager" 2024-02-22T19:08:30.234 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:08:29 smithi063 bash[44872]: t=2024-02-22T19:08:29+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=127.0.0.1:3000 protocol=https subUrl= socket= 2024-02-22T19:08:30.720 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:30 smithi062 bash[64101]: cluster 2024-02-22T19:08:29.482877+0000 mgr.y (mgr.14140) 194 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:30.720 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:30 smithi062 bash[67442]: cluster 2024-02-22T19:08:29.482877+0000 mgr.y (mgr.14140) 194 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:30.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:30 smithi063 bash[35391]: cluster 2024-02-22T19:08:29.482877+0000 mgr.y (mgr.14140) 194 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:31.578 INFO:teuthology.orchestra.run.smithi062.stdout:68719476775 2024-02-22T19:08:32.460 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476771 got 68719476775 for osd.1 2024-02-22T19:08:32.461 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-22T19:08:32.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:32 smithi062 bash[64101]: cluster 2024-02-22T19:08:31.483195+0000 mgr.y (mgr.14140) 195 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:32.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:32 smithi062 bash[64101]: audit 2024-02-22T19:08:31.577108+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.15.62:0/1912364405' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-22T19:08:32.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:32 smithi062 bash[67442]: cluster 2024-02-22T19:08:31.483195+0000 mgr.y (mgr.14140) 195 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:32.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:32 smithi062 bash[67442]: audit 2024-02-22T19:08:31.577108+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.15.62:0/1912364405' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-22T19:08:32.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:32 smithi063 bash[35391]: cluster 2024-02-22T19:08:31.483195+0000 mgr.y (mgr.14140) 195 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:32.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:32 smithi063 bash[35391]: audit 2024-02-22T19:08:31.577108+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.15.62:0/1912364405' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-22T19:08:34.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:34 smithi063 bash[35391]: cluster 2024-02-22T19:08:33.483512+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:34.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:34 smithi062 bash[64101]: cluster 2024-02-22T19:08:33.483512+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:34.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:34 smithi062 bash[67442]: cluster 2024-02-22T19:08:33.483512+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:35.625 INFO:teuthology.orchestra.run.smithi062.stdout:90194313251 2024-02-22T19:08:36.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:36 smithi062 bash[64101]: cluster 2024-02-22T19:08:35.483793+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:36.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:36 smithi062 bash[64101]: audit 2024-02-22T19:08:35.624396+0000 mon.a (mon.0) 499 : audit [DBG] from='client.? 172.21.15.62:0/1034378386' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-22T19:08:36.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:36 smithi062 bash[67442]: cluster 2024-02-22T19:08:35.483793+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:36.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:36 smithi062 bash[67442]: audit 2024-02-22T19:08:35.624396+0000 mon.a (mon.0) 499 : audit [DBG] from='client.? 172.21.15.62:0/1034378386' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-22T19:08:36.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:36 smithi062 bash[64101]: audit 2024-02-22T19:08:36.289965+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288735\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288836\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288872\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288904\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288935\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288965\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288995\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.289025\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"b775ea6ece12\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.289055\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:09.445450\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:53.496396\"}}, \"last_daemon_update\": \"2024-02-22T19:08:36.289144\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:08:36.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:36 smithi062 bash[64101]: audit 2024-02-22T19:08:36.293031+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288735\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288836\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288872\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288904\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288935\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288965\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288995\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.289025\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"b775ea6ece12\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.289055\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:09.445450\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:53.496396\"}}, \"last_daemon_update\": \"2024-02-22T19:08:36.289144\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:08:36.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:36 smithi062 bash[64101]: audit 2024-02-22T19:08:36.293590+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:08:36.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:36 smithi062 bash[67442]: audit 2024-02-22T19:08:36.289965+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288735\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288836\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288872\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288904\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288935\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288965\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288995\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.289025\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"b775ea6ece12\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.289055\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:09.445450\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:53.496396\"}}, \"last_daemon_update\": \"2024-02-22T19:08:36.289144\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:08:36.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:36 smithi062 bash[67442]: audit 2024-02-22T19:08:36.293031+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288735\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288836\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288872\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288904\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288935\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288965\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288995\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.289025\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"b775ea6ece12\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.289055\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:09.445450\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:53.496396\"}}, \"last_daemon_update\": \"2024-02-22T19:08:36.289144\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:08:36.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:36 smithi062 bash[67442]: audit 2024-02-22T19:08:36.293590+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:08:36.739 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:36 smithi063 bash[35391]: cluster 2024-02-22T19:08:35.483793+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:36.739 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:36 smithi063 bash[35391]: audit 2024-02-22T19:08:35.624396+0000 mon.a (mon.0) 499 : audit [DBG] from='client.? 172.21.15.62:0/1034378386' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-22T19:08:36.739 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:36 smithi063 bash[35391]: audit 2024-02-22T19:08:36.289965+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288735\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288836\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288872\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288904\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288935\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288965\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288995\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.289025\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"b775ea6ece12\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.289055\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:09.445450\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:53.496396\"}}, \"last_daemon_update\": \"2024-02-22T19:08:36.289144\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:08:36.739 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:36 smithi063 bash[35391]: audit 2024-02-22T19:08:36.293031+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288735\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288836\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288872\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288904\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288935\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288965\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288995\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.289025\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"b775ea6ece12\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.289055\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:09.445450\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:53.496396\"}}, \"last_daemon_update\": \"2024-02-22T19:08:36.289144\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:08:36.739 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:36 smithi063 bash[35391]: audit 2024-02-22T19:08:36.293590+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:08:36.785 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313248 got 90194313251 for osd.2 2024-02-22T19:08:36.785 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-22T19:08:38.593 INFO:teuthology.orchestra.run.smithi062.stdout:111669149727 2024-02-22T19:08:38.709 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:38 smithi063 bash[35391]: cluster 2024-02-22T19:08:37.484066+0000 mgr.y (mgr.14140) 198 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:38.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:38 smithi062 bash[64101]: cluster 2024-02-22T19:08:37.484066+0000 mgr.y (mgr.14140) 198 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:38.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:38 smithi062 bash[67442]: cluster 2024-02-22T19:08:37.484066+0000 mgr.y (mgr.14140) 198 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:39.204 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149723 got 111669149727 for osd.3 2024-02-22T19:08:39.205 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-22T19:08:39.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:39 smithi063 bash[35391]: audit 2024-02-22T19:08:38.592977+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.62:0/986336444' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-22T19:08:39.820 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:39 smithi062 bash[64101]: audit 2024-02-22T19:08:38.592977+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.62:0/986336444' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-22T19:08:39.820 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:39 smithi062 bash[67442]: audit 2024-02-22T19:08:38.592977+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.62:0/986336444' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-22T19:08:40.720 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:40 smithi062 bash[64101]: cluster 2024-02-22T19:08:39.484584+0000 mgr.y (mgr.14140) 199 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:40.720 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:40 smithi062 bash[64101]: audit 2024-02-22T19:08:39.647903+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646734\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646809\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646844\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646875\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646904\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646933\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646963\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646992\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.647021\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_daemon_update\": \"2024-02-22T19:08:39.647115\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:08:40.720 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:40 smithi062 bash[67442]: cluster 2024-02-22T19:08:39.484584+0000 mgr.y (mgr.14140) 199 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:40.720 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:40 smithi062 bash[67442]: audit 2024-02-22T19:08:39.647903+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646734\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646809\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646844\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646875\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646904\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646933\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646963\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646992\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.647021\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_daemon_update\": \"2024-02-22T19:08:39.647115\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:08:40.720 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:40 smithi062 bash[64101]: audit 2024-02-22T19:08:39.650714+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646734\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646809\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646844\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646875\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646904\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646933\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646963\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646992\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.647021\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_daemon_update\": \"2024-02-22T19:08:39.647115\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:08:40.721 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:40 smithi062 bash[67442]: audit 2024-02-22T19:08:39.650714+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646734\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646809\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646844\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646875\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646904\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646933\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646963\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646992\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.647021\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_daemon_update\": \"2024-02-22T19:08:39.647115\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:08:40.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:40 smithi063 bash[35391]: cluster 2024-02-22T19:08:39.484584+0000 mgr.y (mgr.14140) 199 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:40.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:40 smithi063 bash[35391]: audit 2024-02-22T19:08:39.647903+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646734\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646809\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646844\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646875\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646904\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646933\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646963\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646992\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.647021\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_daemon_update\": \"2024-02-22T19:08:39.647115\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:08:40.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:40 smithi063 bash[35391]: audit 2024-02-22T19:08:39.650714+0000 mon.a (mon.0) 504 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646734\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646809\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646844\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646875\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646904\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646933\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"beabf5f3fd3a\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646963\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:07:50.117443\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646992\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.647021\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:07:30.525484\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_daemon_update\": \"2024-02-22T19:08:39.647115\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:08:41.342 INFO:teuthology.orchestra.run.smithi062.stdout:133143986204 2024-02-22T19:08:41.918 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:41 smithi062 bash[64101]: cephadm 2024-02-22T19:08:39.652629+0000 mgr.y (mgr.14140) 200 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-22T19:08:41.918 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:41 smithi062 bash[64101]: cephadm 2024-02-22T19:08:39.654429+0000 mgr.y (mgr.14140) 201 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi062 2024-02-22T19:08:41.918 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:41 smithi062 bash[64101]: audit 2024-02-22T19:08:41.056904+0000 mon.a (mon.0) 505 : audit [DBG] from='client.? 172.21.15.62:0/3002272027' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-22T19:08:41.918 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:41 smithi062 bash[67442]: cephadm 2024-02-22T19:08:39.652629+0000 mgr.y (mgr.14140) 200 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-22T19:08:41.918 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:41 smithi062 bash[67442]: cephadm 2024-02-22T19:08:39.654429+0000 mgr.y (mgr.14140) 201 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi062 2024-02-22T19:08:41.918 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:41 smithi062 bash[67442]: audit 2024-02-22T19:08:41.056904+0000 mon.a (mon.0) 505 : audit [DBG] from='client.? 172.21.15.62:0/3002272027' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-22T19:08:41.929 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986200 got 133143986204 for osd.4 2024-02-22T19:08:41.929 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-22T19:08:41.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:41 smithi063 bash[35391]: cephadm 2024-02-22T19:08:39.652629+0000 mgr.y (mgr.14140) 200 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-22T19:08:41.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:41 smithi063 bash[35391]: cephadm 2024-02-22T19:08:39.654429+0000 mgr.y (mgr.14140) 201 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi062 2024-02-22T19:08:41.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:41 smithi063 bash[35391]: audit 2024-02-22T19:08:41.056904+0000 mon.a (mon.0) 505 : audit [DBG] from='client.? 172.21.15.62:0/3002272027' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-22T19:08:42.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:42 smithi062 bash[64101]: cluster 2024-02-22T19:08:41.484877+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:42.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:42 smithi062 bash[67442]: cluster 2024-02-22T19:08:41.484877+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:42.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:42 smithi063 bash[35391]: cluster 2024-02-22T19:08:41.484877+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:44.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:44 smithi062 bash[64101]: cluster 2024-02-22T19:08:43.485211+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:44.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:44 smithi062 bash[67442]: cluster 2024-02-22T19:08:43.485211+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:44.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:44 smithi063 bash[35391]: cluster 2024-02-22T19:08:43.485211+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:45.234 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:44 smithi062 systemd[1]: Stopping Ceph alertmanager.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:08:45.235 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:45 smithi062 bash[76945]: ts=2024-02-22T19:08:45.138Z caller=main.go:594 level=info msg="Received SIGTERM, exiting gracefully..." 2024-02-22T19:08:46.297 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:46 smithi062 podman[79605]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-alertmanager.a 2024-02-22T19:08:46.298 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:46 smithi062 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@alertmanager.a.service: Succeeded. 2024-02-22T19:08:46.298 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:46 smithi062 systemd[1]: Stopped Ceph alertmanager.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:08:46.298 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:46 smithi062 systemd[1]: Starting Ceph alertmanager.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:08:46.671 INFO:teuthology.orchestra.run.smithi062.stdout:154618822681 2024-02-22T19:08:46.699 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:46 smithi062 bash[64101]: cluster 2024-02-22T19:08:45.485707+0000 mgr.y (mgr.14140) 204 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:46.699 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:46 smithi062 podman[79682]: Error: no container with ID or name "ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-alertmanager.a" found: no such container 2024-02-22T19:08:46.699 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:46 smithi062 systemd[1]: Started Ceph alertmanager.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:08:46.700 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:46 smithi062 bash[67442]: cluster 2024-02-22T19:08:45.485707+0000 mgr.y (mgr.14140) 204 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:46.700 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:46 smithi062 bash[64101]: audit 2024-02-22T19:08:46.327318+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288735\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288836\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288872\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288904\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288935\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288965\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288995\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.289025\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:08:46.700 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:46 smithi062 bash[64101]: audit 2024-02-22T19:08:46.331466+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288735\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288836\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288872\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288904\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288935\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288965\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288995\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.289025\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:08:46.700 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:46 smithi062 bash[67442]: audit 2024-02-22T19:08:46.327318+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288735\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288836\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288872\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288904\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288935\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288965\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288995\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.289025\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:08:46.701 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:46 smithi062 bash[67442]: audit 2024-02-22T19:08:46.331466+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288735\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288836\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288872\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288904\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288935\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288965\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288995\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.289025\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:08:46.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:46 smithi063 bash[35391]: cluster 2024-02-22T19:08:45.485707+0000 mgr.y (mgr.14140) 204 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:46.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:46 smithi063 bash[35391]: audit 2024-02-22T19:08:46.327318+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288735\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288836\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288872\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288904\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288935\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288965\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288995\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.289025\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:08:46.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:46 smithi063 bash[35391]: audit 2024-02-22T19:08:46.331466+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288735\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288836\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288872\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288904\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288935\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288965\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.288995\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:36.289025\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:08:47.468 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:47 smithi062 bash[79699]: ts=2024-02-22T19:08:47.052Z caller=main.go:245 level=info msg="Starting Alertmanager" version="(version=0.26.0, branch=HEAD, revision=d7b4f0c7322e7151d6e3b1e31cbc15361e295d8d)" 2024-02-22T19:08:47.468 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:47 smithi062 bash[79699]: ts=2024-02-22T19:08:47.052Z caller=main.go:246 level=info build_context="(go=go1.20.7, platform=linux/amd64, user=root@df8d7debeef4, date=20230824-11:11:58, tags=netgo)" 2024-02-22T19:08:47.468 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:47 smithi062 bash[79699]: ts=2024-02-22T19:08:47.053Z caller=cluster.go:186 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.62 port=9094 2024-02-22T19:08:47.468 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:47 smithi062 bash[79699]: ts=2024-02-22T19:08:47.055Z caller=cluster.go:683 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-22T19:08:47.468 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:47 smithi062 bash[79699]: ts=2024-02-22T19:08:47.077Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-22T19:08:47.468 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:47 smithi062 bash[79699]: ts=2024-02-22T19:08:47.077Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-22T19:08:47.468 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:47 smithi062 bash[79699]: ts=2024-02-22T19:08:47.079Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9093 2024-02-22T19:08:47.468 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:47 smithi062 bash[79699]: ts=2024-02-22T19:08:47.079Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-02-22T19:08:47.591 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822677 got 154618822681 for osd.5 2024-02-22T19:08:47.591 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-02-22T19:08:47.613 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:47 smithi063 bash[35391]: cephadm 2024-02-22T19:08:46.332050+0000 mgr.y (mgr.14140) 205 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-22T19:08:47.613 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:47 smithi063 bash[35391]: cephadm 2024-02-22T19:08:46.334121+0000 mgr.y (mgr.14140) 206 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi063 2024-02-22T19:08:47.613 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:47 smithi063 bash[35391]: audit 2024-02-22T19:08:46.670223+0000 mon.a (mon.0) 508 : audit [DBG] from='client.? 172.21.15.62:0/4135667634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-22T19:08:47.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:47 smithi062 bash[64101]: cephadm 2024-02-22T19:08:46.332050+0000 mgr.y (mgr.14140) 205 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-22T19:08:47.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:47 smithi062 bash[64101]: cephadm 2024-02-22T19:08:46.334121+0000 mgr.y (mgr.14140) 206 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi063 2024-02-22T19:08:47.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:47 smithi062 bash[64101]: audit 2024-02-22T19:08:46.670223+0000 mon.a (mon.0) 508 : audit [DBG] from='client.? 172.21.15.62:0/4135667634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-22T19:08:47.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:47 smithi062 bash[67442]: cephadm 2024-02-22T19:08:46.332050+0000 mgr.y (mgr.14140) 205 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-22T19:08:47.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:47 smithi062 bash[67442]: cephadm 2024-02-22T19:08:46.334121+0000 mgr.y (mgr.14140) 206 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi063 2024-02-22T19:08:47.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:47 smithi062 bash[67442]: audit 2024-02-22T19:08:46.670223+0000 mon.a (mon.0) 508 : audit [DBG] from='client.? 172.21.15.62:0/4135667634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-22T19:08:48.668 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:48 smithi063 bash[35391]: cluster 2024-02-22T19:08:47.485990+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:48.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:48 smithi062 bash[64101]: cluster 2024-02-22T19:08:47.485990+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:48.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:48 smithi062 bash[67442]: cluster 2024-02-22T19:08:47.485990+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:49.403 INFO:teuthology.orchestra.run.smithi062.stdout:176093659157 2024-02-22T19:08:49.432 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:49 smithi062 bash[79699]: ts=2024-02-22T19:08:49.055Z caller=cluster.go:708 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000454631s 2024-02-22T19:08:49.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:49 smithi063 bash[35391]: audit 2024-02-22T19:08:49.402669+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.15.62:0/2868681387' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-22T19:08:49.714 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:49 smithi063 systemd[1]: Stopping Ceph prometheus.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:08:49.714 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:49 smithi063 bash[44164]: ts=2024-02-22T19:08:49.577Z caller=main.go:953 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-02-22T19:08:49.714 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:49 smithi063 bash[44164]: ts=2024-02-22T19:08:49.578Z caller=main.go:977 level=info msg="Stopping scrape discovery manager..." 2024-02-22T19:08:49.714 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:49 smithi063 bash[44164]: ts=2024-02-22T19:08:49.578Z caller=main.go:991 level=info msg="Stopping notify discovery manager..." 2024-02-22T19:08:49.714 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:49 smithi063 bash[44164]: ts=2024-02-22T19:08:49.578Z caller=manager.go:160 level=info component="rule manager" msg="Stopping rule manager..." 2024-02-22T19:08:49.714 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:49 smithi063 bash[44164]: ts=2024-02-22T19:08:49.578Z caller=manager.go:170 level=info component="rule manager" msg="Rule manager stopped" 2024-02-22T19:08:49.714 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:49 smithi063 bash[44164]: ts=2024-02-22T19:08:49.578Z caller=main.go:1028 level=info msg="Stopping scrape manager..." 2024-02-22T19:08:49.714 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:49 smithi063 bash[44164]: ts=2024-02-22T19:08:49.578Z caller=main.go:987 level=info msg="Notify discovery manager stopped" 2024-02-22T19:08:49.714 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:49 smithi063 bash[44164]: ts=2024-02-22T19:08:49.578Z caller=main.go:1020 level=info msg="Scrape manager stopped" 2024-02-22T19:08:49.714 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:49 smithi063 bash[44164]: ts=2024-02-22T19:08:49.578Z caller=main.go:973 level=info msg="Scrape discovery manager stopped" 2024-02-22T19:08:49.714 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:49 smithi063 bash[44164]: ts=2024-02-22T19:08:49.578Z caller=notifier.go:604 level=info component=notifier msg="Stopping notification manager..." 2024-02-22T19:08:49.714 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:49 smithi063 bash[44164]: ts=2024-02-22T19:08:49.578Z caller=main.go:1250 level=info msg="Notifier manager stopped" 2024-02-22T19:08:49.715 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:49 smithi063 bash[44164]: ts=2024-02-22T19:08:49.578Z caller=main.go:1262 level=info msg="See you next time!" 2024-02-22T19:08:49.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:49 smithi062 bash[64101]: audit 2024-02-22T19:08:49.402669+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.15.62:0/2868681387' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-22T19:08:49.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:49 smithi062 bash[67442]: audit 2024-02-22T19:08:49.402669+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.15.62:0/2868681387' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-22T19:08:50.153 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:49 smithi063 podman[45501]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-prometheus.a 2024-02-22T19:08:50.231 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659153 got 176093659157 for osd.6 2024-02-22T19:08:50.232 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-02-22T19:08:50.463 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@prometheus.a.service: Succeeded. 2024-02-22T19:08:50.464 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 systemd[1]: Stopped Ceph prometheus.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:08:50.464 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 systemd[1]: Starting Ceph prometheus.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:08:50.464 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 podman[45542]: Error: no container with ID or name "ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-prometheus.a" found: no such container 2024-02-22T19:08:50.464 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 systemd[1]: Started Ceph prometheus.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:08:50.805 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:50 smithi062 bash[64101]: cluster 2024-02-22T19:08:49.486265+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:50.805 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:50 smithi062 bash[64101]: audit 2024-02-22T19:08:50.205001+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646734\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646809\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646844\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646875\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646904\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646933\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646992\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.647021\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:08:50.806 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:50 smithi062 bash[67442]: cluster 2024-02-22T19:08:49.486265+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:50.806 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:50 smithi062 bash[64101]: audit 2024-02-22T19:08:50.207885+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646734\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646809\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646844\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646875\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646904\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646933\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646992\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.647021\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:08:50.806 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:50 smithi062 bash[67442]: audit 2024-02-22T19:08:50.205001+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646734\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646809\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646844\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646875\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646904\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646933\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646992\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.647021\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:08:50.807 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:50 smithi062 bash[64101]: audit 2024-02-22T19:08:50.208445+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi063:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-02-22T19:08:50.807 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:50 smithi062 bash[64101]: audit 2024-02-22T19:08:50.215180+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi063:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2024-02-22T19:08:50.807 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:50 smithi062 bash[64101]: audit 2024-02-22T19:08:50.219063+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:08:50.807 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:50 smithi062 bash[67442]: audit 2024-02-22T19:08:50.207885+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646734\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646809\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646844\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646875\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646904\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646933\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646992\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.647021\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:08:50.807 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:50 smithi062 bash[67442]: audit 2024-02-22T19:08:50.208445+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi063:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-02-22T19:08:50.808 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:50 smithi062 bash[67442]: audit 2024-02-22T19:08:50.215180+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi063:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2024-02-22T19:08:50.808 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:50 smithi062 bash[67442]: audit 2024-02-22T19:08:50.219063+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:08:50.812 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[35391]: cluster 2024-02-22T19:08:49.486265+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:50.812 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[35391]: audit 2024-02-22T19:08:50.205001+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646734\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646809\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646844\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646875\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646904\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646933\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646992\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.647021\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:08:50.812 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[35391]: audit 2024-02-22T19:08:50.207885+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646734\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646809\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646844\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646875\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646904\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646933\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.646992\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:39.647021\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:08:50.812 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[35391]: audit 2024-02-22T19:08:50.208445+0000 mon.a (mon.0) 511 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi063:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-02-22T19:08:50.812 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[35391]: audit 2024-02-22T19:08:50.215180+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi063:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2024-02-22T19:08:50.813 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[35391]: audit 2024-02-22T19:08:50.219063+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:08:51.214 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.728Z caller=main.go:564 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-02-22T19:08:51.214 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.728Z caller=main.go:608 level=info msg="Starting Prometheus Server" mode=server version="(version=2.50.0, branch=HEAD, revision=814b920e8a6345d35712b5857ebd4cb5e90fc107)" 2024-02-22T19:08:51.214 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.728Z caller=main.go:613 level=info build_context="(go=go1.21.7, platform=linux/amd64, user=root@384077e1cf50, date=20240222-09:38:19, tags=netgo,builtinassets,stringlabels)" 2024-02-22T19:08:51.214 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.728Z caller=main.go:614 level=info host_details="(Linux 4.18.0-540.el8.x86_64 #1 SMP Fri Feb 9 14:58:00 UTC 2024 x86_64 smithi063 (none))" 2024-02-22T19:08:51.214 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.728Z caller=main.go:615 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-02-22T19:08:51.214 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.728Z caller=main.go:616 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-22T19:08:51.214 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.730Z caller=web.go:565 level=info component=web msg="Start listening for connections" address=:9095 2024-02-22T19:08:51.215 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.730Z caller=main.go:1118 level=info msg="Starting TSDB ..." 2024-02-22T19:08:51.215 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.732Z caller=tls_config.go:313 level=info component=web msg="Listening on" address=[::]:9095 2024-02-22T19:08:51.215 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.732Z caller=tls_config.go:316 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-02-22T19:08:51.215 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.734Z caller=head.go:610 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-02-22T19:08:51.215 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.734Z caller=head.go:692 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.858µs 2024-02-22T19:08:51.215 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.734Z caller=head.go:700 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-02-22T19:08:51.215 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.734Z caller=head.go:771 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-02-22T19:08:51.215 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.734Z caller=head.go:771 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-02-22T19:08:51.215 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.734Z caller=head.go:808 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=30.846µs wal_replay_duration=306.08µs wbl_replay_duration=121ns total_replay_duration=356.257µs 2024-02-22T19:08:51.215 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.735Z caller=main.go:1139 level=info fs_type=XFS_SUPER_MAGIC 2024-02-22T19:08:51.215 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.735Z caller=main.go:1142 level=info msg="TSDB started" 2024-02-22T19:08:51.215 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.735Z caller=main.go:1324 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-22T19:08:51.216 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.736Z caller=main.go:1361 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=570.911µs db_storage=844ns remote_storage=1.346µs web_handler=436ns query_engine=672ns scrape=231.289µs scrape_sd=24.168µs notify=23.421µs notify_sd=6.834µs rules=27.878µs tracing=4.131µs 2024-02-22T19:08:51.216 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.736Z caller=main.go:1103 level=info msg="Server is ready to receive web requests." 2024-02-22T19:08:51.216 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:08:50 smithi063 bash[45557]: ts=2024-02-22T19:08:50.736Z caller=manager.go:146 level=info component="rule manager" msg="Starting rule manager..." 2024-02-22T19:08:51.786 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:51 smithi062 bash[64101]: cephadm 2024-02-22T19:08:50.208253+0000 mgr.y (mgr.14140) 209 : cephadm [INF] Setting dashboard grafana config to https://smithi063:3000 2024-02-22T19:08:51.786 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:51 smithi062 bash[67442]: cephadm 2024-02-22T19:08:50.208253+0000 mgr.y (mgr.14140) 209 : cephadm [INF] Setting dashboard grafana config to https://smithi063:3000 2024-02-22T19:08:51.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:51 smithi063 bash[35391]: cephadm 2024-02-22T19:08:50.208253+0000 mgr.y (mgr.14140) 209 : cephadm [INF] Setting dashboard grafana config to https://smithi063:3000 2024-02-22T19:08:52.543 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:52 smithi062 bash[67442]: cluster 2024-02-22T19:08:51.486528+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:52.640 INFO:teuthology.orchestra.run.smithi062.stdout:197568495635 2024-02-22T19:08:52.953 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:52 smithi062 bash[64101]: cluster 2024-02-22T19:08:51.486528+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:52.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:52 smithi063 bash[35391]: cluster 2024-02-22T19:08:51.486528+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:53.261 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495630 got 197568495635 for osd.7 2024-02-22T19:08:53.261 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-22T19:08:53.262 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph pg dump --format=json 2024-02-22T19:08:53.547 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:53 smithi062 bash[67442]: audit 2024-02-22T19:08:52.640135+0000 mon.a (mon.0) 514 : audit [DBG] from='client.? 172.21.15.62:0/2996043776' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-22T19:08:53.922 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:53 smithi062 bash[64101]: audit 2024-02-22T19:08:52.640135+0000 mon.a (mon.0) 514 : audit [DBG] from='client.? 172.21.15.62:0/2996043776' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-22T19:08:53.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:53 smithi063 bash[35391]: audit 2024-02-22T19:08:52.640135+0000 mon.a (mon.0) 514 : audit [DBG] from='client.? 172.21.15.62:0/2996043776' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-22T19:08:54.819 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:54 smithi062 bash[64101]: cluster 2024-02-22T19:08:53.486798+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:54.819 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:54 smithi062 bash[67442]: cluster 2024-02-22T19:08:53.486798+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:54.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:54 smithi063 bash[35391]: cluster 2024-02-22T19:08:53.486798+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:55.415 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T19:08:55.416 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-02-22T19:08:56.138 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-02-22T19:08:53.486680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":8392208,"kb_used_data":3536,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":741569008,"statfs":{"total":767960285184,"available":759366664192,"internally_reserved":8589934592,"allocated":3620864,"data_stored":1442760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001941"},"pg_stats":[{"pgid":"1.0","version":"17'1","reported_seq":"14","reported_epoch":"47","state":"active+clean","last_fresh":"2024-02-22T19:07:28.558931+0000","last_change":"2024-02-22T19:07:28.558931+0000","last_active":"2024-02-22T19:07:28.558931+0000","last_peered":"2024-02-22T19:07:28.558931+0000","last_clean":"2024-02-22T19:07:28.558931+0000","last_became_active":"2024-02-22T19:07:28.555128+0000","last_became_peered":"2024-02-22T19:07:28.555128+0000","last_unstale":"2024-02-22T19:07:28.558931+0000","last_undegraded":"2024-02-22T19:07:28.558931+0000","last_fullsized":"2024-02-22T19:07:28.558931+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-22T19:02:55.521931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-22T19:02:55.521931+0000","last_clean_scrub_stamp":"2024-02-22T19:02:55.521931+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":46,"seq":197568495636,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.73099999999999998}]},{"osd":1,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.746},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.77800000000000002}]},{"osd":2,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.755}]},{"osd":3,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.80000000000000004}]},{"osd":4,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.64900000000000002}]}]},{"osd":6,"up_from":41,"seq":176093659158,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049024,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696128,"statfs":{"total":95995035648,"available":94920835072,"internally_reserved":1073741824,"allocated":450560,"data_stored":180198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 19:08:11 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.47499999999999998}]},{"osd":1,"last update":"Thu Feb 22 19:08:11 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.28499999999999998}]},{"osd":2,"last update":"Thu Feb 22 19:08:11 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.434},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.39000000000000001}]},{"osd":3,"last update":"Thu Feb 22 19:08:11 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.308},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.40300000000000002}]},{"osd":4,"last update":"Thu Feb 22 19:08:11 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.38}]},{"osd":5,"last update":"Thu Feb 22 19:08:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Feb 22 19:08:29 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.41399999999999998}]}]},{"osd":1,"up_from":16,"seq":68719476779,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049024,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696128,"statfs":{"total":95995035648,"available":94920835072,"internally_reserved":1073741824,"allocated":450560,"data_stored":180198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 19:08:37 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.309,"15min":0.29399999999999998},"min":{"1min":0.214,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.312,"15min":0.29599999999999999},"min":{"1min":0.20300000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.32700000000000001}]},{"osd":2,"last update":"Thu Feb 22 19:07:57 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.24099999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48199999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.251},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.372,"15min":0.36899999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Feb 22 19:08:15 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42299999999999999,"15min":0.42499999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.40600000000000003,"15min":0.41199999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51700000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.379}]},{"osd":4,"last update":"Thu Feb 22 19:08:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.49299999999999999,"15min":0.48899999999999999},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Feb 22 19:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.42199999999999999}]},{"osd":6,"last update":"Thu Feb 22 19:08:09 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Feb 22 19:08:30 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.49299999999999999}]}]},{"osd":0,"up_from":10,"seq":42949673007,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 22 19:08:40 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.316,"15min":0.30599999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.45800000000000002,"5min":0.622,"15min":0.622},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32800000000000001,"15min":0.32000000000000001},"min":{"1min":0.215,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.49299999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Feb 22 19:07:55 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34799999999999998,"15min":0.34599999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.378,"15min":0.376},"min":{"1min":0.307,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.215}]},{"osd":3,"last update":"Thu Feb 22 19:08:17 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.38300000000000001,"15min":0.38800000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.45800000000000002,"5min":0.5,"15min":0.5},"last":0.252},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41599999999999998,"15min":0.42099999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.52800000000000002,"15min":0.52000000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.35499999999999998}]},{"osd":5,"last update":"Thu Feb 22 19:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.313}]},{"osd":6,"last update":"Thu Feb 22 19:08:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.39200000000000002}]},{"osd":7,"last update":"Thu Feb 22 19:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.42599999999999999}]}]},{"osd":2,"up_from":21,"seq":90194313255,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049024,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696128,"statfs":{"total":95995035648,"available":94920835072,"internally_reserved":1073741824,"allocated":450560,"data_stored":180198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 19:07:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35899999999999999,"15min":0.36199999999999999},"min":{"1min":0.217,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.54800000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.378,"15min":0.376},"min":{"1min":0.22800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.64600000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Feb 22 19:07:57 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.375,"15min":0.373},"min":{"1min":0.26600000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52300000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38900000000000001,"15min":0.39000000000000001},"min":{"1min":0.27700000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.29399999999999998}]},{"osd":3,"last update":"Thu Feb 22 19:08:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38900000000000001,"15min":0.38800000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.308},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40899999999999997,"15min":0.41099999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Feb 22 19:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.377},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65500000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.434}]},{"osd":5,"last update":"Thu Feb 22 19:07:51 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.36099999999999999}]},{"osd":6,"last update":"Thu Feb 22 19:08:11 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.41099999999999998}]},{"osd":7,"last update":"Thu Feb 22 19:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.42099999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149730,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 19:08:16 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34799999999999998,"15min":0.34999999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.224},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.40999999999999998,"15min":0.41299999999999998},"min":{"1min":0.25,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.27200000000000002}]},{"osd":1,"last update":"Thu Feb 22 19:08:16 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.39600000000000002,"15min":0.40000000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.249}]},{"osd":2,"last update":"Thu Feb 22 19:08:16 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.42399999999999999,"15min":0.42599999999999999},"min":{"1min":0.27000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Feb 22 19:08:29 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.76000000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.38200000000000001}]},{"osd":5,"last update":"Thu Feb 22 19:07:52 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.39100000000000001}]},{"osd":6,"last update":"Thu Feb 22 19:08:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.40999999999999998}]},{"osd":7,"last update":"Thu Feb 22 19:08:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.42199999999999999}]}]},{"osd":4,"up_from":31,"seq":133143986207,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049024,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696128,"statfs":{"total":95995035648,"available":94920835072,"internally_reserved":1073741824,"allocated":450560,"data_stored":180198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35599999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.34799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67200000000000004,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46600000000000003,"15min":0.46800000000000003},"min":{"1min":0.315,"5min":0.31,"15min":0.31},"max":{"1min":0.61199999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48099999999999998,"15min":0.48199999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66300000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.47599999999999998,"15min":0.47799999999999998},"min":{"1min":0.32900000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.442}]},{"osd":3,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52400000000000002,"15min":0.52900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.64100000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48199999999999998,"15min":0.48099999999999998},"min":{"1min":0.35099999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.371}]},{"osd":5,"last update":"Thu Feb 22 19:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.314}]},{"osd":6,"last update":"Thu Feb 22 19:08:10 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.34100000000000003}]},{"osd":7,"last update":"Thu Feb 22 19:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.437},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.51700000000000002}]}]},{"osd":5,"up_from":36,"seq":154618822683,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 19:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Feb 22 19:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Feb 22 19:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Feb 22 19:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.495}]},{"osd":4,"last update":"Thu Feb 22 19:07:50 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.29199999999999998}]},{"osd":6,"last update":"Thu Feb 22 19:08:08 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.35899999999999999}]},{"osd":7,"last update":"Thu Feb 22 19:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.34699999999999998}]}]}]}} 2024-02-22T19:08:56.140 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph pg dump --format=json 2024-02-22T19:08:56.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:56 smithi062 bash[64101]: audit 2024-02-22T19:08:55.411660+0000 mgr.y (mgr.14140) 212 : audit [DBG] from='client.24493 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-22T19:08:56.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:56 smithi062 bash[64101]: cluster 2024-02-22T19:08:55.487162+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:56.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:56 smithi062 bash[67442]: audit 2024-02-22T19:08:55.411660+0000 mgr.y (mgr.14140) 212 : audit [DBG] from='client.24493 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-22T19:08:56.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:56 smithi062 bash[67442]: cluster 2024-02-22T19:08:55.487162+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:56.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:56 smithi063 bash[35391]: audit 2024-02-22T19:08:55.411660+0000 mgr.y (mgr.14140) 212 : audit [DBG] from='client.24493 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-22T19:08:56.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:56 smithi063 bash[35391]: cluster 2024-02-22T19:08:55.487162+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:57.234 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:08:57 smithi062 bash[79699]: ts=2024-02-22T19:08:57.058Z caller=cluster.go:700 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003291011s 2024-02-22T19:08:57.595 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:57 smithi062 bash[64101]: audit 2024-02-22T19:08:56.809179+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808052\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808128\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808162\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808193\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808223\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808252\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808281\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808310\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808339\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}}, \"last_daemon_update\": \"2024-02-22T19:08:56.808411\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:08:57.595 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:57 smithi062 bash[64101]: audit 2024-02-22T19:08:56.811842+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808052\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808128\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808162\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808193\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808223\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808252\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808281\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808310\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808339\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}}, \"last_daemon_update\": \"2024-02-22T19:08:56.808411\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:08:57.595 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:57 smithi062 bash[64101]: audit 2024-02-22T19:08:56.812279+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:08:57.596 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:57 smithi062 bash[67442]: audit 2024-02-22T19:08:56.809179+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808052\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808128\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808162\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808193\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808223\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808252\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808281\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808310\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808339\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}}, \"last_daemon_update\": \"2024-02-22T19:08:56.808411\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:08:57.596 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:57 smithi062 bash[67442]: audit 2024-02-22T19:08:56.811842+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808052\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808128\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808162\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808193\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808223\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808252\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808281\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808310\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808339\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}}, \"last_daemon_update\": \"2024-02-22T19:08:56.808411\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:08:57.596 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:57 smithi062 bash[67442]: audit 2024-02-22T19:08:56.812279+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:08:57.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:57 smithi063 bash[35391]: audit 2024-02-22T19:08:56.809179+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808052\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808128\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808162\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808193\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808223\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808252\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808281\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808310\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808339\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}}, \"last_daemon_update\": \"2024-02-22T19:08:56.808411\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:08:57.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:57 smithi063 bash[35391]: audit 2024-02-22T19:08:56.811842+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808052\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808128\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808162\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808193\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808223\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808252\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808281\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808310\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:08:56.808339\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}}, \"last_daemon_update\": \"2024-02-22T19:08:56.808411\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:08:57.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:57 smithi063 bash[35391]: audit 2024-02-22T19:08:56.812279+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:08:58.168 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T19:08:58.169 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-02-22T19:08:58.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:58 smithi062 bash[64101]: cluster 2024-02-22T19:08:57.487435+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:58.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:58 smithi062 bash[67442]: cluster 2024-02-22T19:08:57.487435+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:58.803 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2024-02-22T19:08:57.487313+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":8392208,"kb_used_data":3536,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":741569008,"statfs":{"total":767960285184,"available":759366664192,"internally_reserved":8589934592,"allocated":3620864,"data_stored":1442760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001866"},"pg_stats":[{"pgid":"1.0","version":"17'1","reported_seq":"14","reported_epoch":"47","state":"active+clean","last_fresh":"2024-02-22T19:07:28.558931+0000","last_change":"2024-02-22T19:07:28.558931+0000","last_active":"2024-02-22T19:07:28.558931+0000","last_peered":"2024-02-22T19:07:28.558931+0000","last_clean":"2024-02-22T19:07:28.558931+0000","last_became_active":"2024-02-22T19:07:28.555128+0000","last_became_peered":"2024-02-22T19:07:28.555128+0000","last_unstale":"2024-02-22T19:07:28.558931+0000","last_undegraded":"2024-02-22T19:07:28.558931+0000","last_fullsized":"2024-02-22T19:07:28.558931+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-22T19:02:55.521931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-22T19:02:55.521931+0000","last_clean_scrub_stamp":"2024-02-22T19:02:55.521931+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":46,"seq":197568495636,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.73099999999999998}]},{"osd":1,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.746},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.77800000000000002}]},{"osd":2,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.755}]},{"osd":3,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.80000000000000004}]},{"osd":4,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.68100000000000005}]},{"osd":6,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.64900000000000002}]}]},{"osd":6,"up_from":41,"seq":176093659159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049024,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696128,"statfs":{"total":95995035648,"available":94920835072,"internally_reserved":1073741824,"allocated":450560,"data_stored":180198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 19:08:11 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.52300000000000002}]},{"osd":1,"last update":"Thu Feb 22 19:08:11 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.497}]},{"osd":2,"last update":"Thu Feb 22 19:08:11 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Feb 22 19:08:11 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Feb 22 19:08:11 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Feb 22 19:08:11 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.53600000000000003}]},{"osd":7,"last update":"Thu Feb 22 19:08:29 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.50700000000000001}]}]},{"osd":1,"up_from":16,"seq":68719476780,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049024,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696128,"statfs":{"total":95995035648,"available":94920835072,"internally_reserved":1073741824,"allocated":450560,"data_stored":180198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 19:08:37 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.309,"15min":0.29399999999999998},"min":{"1min":0.214,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.312,"15min":0.29599999999999999},"min":{"1min":0.20300000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"last":0.20000000000000001}]},{"osd":2,"last update":"Thu Feb 22 19:07:57 2024","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.24099999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.48199999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.372,"15min":0.36899999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Feb 22 19:08:15 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.42299999999999999,"15min":0.42499999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.374},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.40600000000000003,"15min":0.41199999999999998},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51700000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.26900000000000002}]},{"osd":4,"last update":"Thu Feb 22 19:08:30 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51900000000000002,"15min":0.52000000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.49299999999999999,"15min":0.48899999999999999},"min":{"1min":0.377,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.30599999999999999}]},{"osd":5,"last update":"Thu Feb 22 19:08:53 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.495,"15min":0.49299999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.34999999999999998}]},{"osd":6,"last update":"Thu Feb 22 19:08:09 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.38200000000000001}]},{"osd":7,"last update":"Thu Feb 22 19:08:30 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.38900000000000001}]}]},{"osd":0,"up_from":10,"seq":42949673008,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 22 19:08:40 2024","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.316,"15min":0.30599999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.45800000000000002,"5min":0.622,"15min":0.622},"last":0.314},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32800000000000001,"15min":0.32000000000000001},"min":{"1min":0.215,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.49299999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.28599999999999998}]},{"osd":2,"last update":"Thu Feb 22 19:07:55 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.34799999999999998,"15min":0.34599999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.378,"15min":0.376},"min":{"1min":0.307,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Feb 22 19:08:17 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.38300000000000001,"15min":0.38800000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.45800000000000002,"5min":0.5,"15min":0.5},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41599999999999998,"15min":0.42099999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55500000000000005,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.44},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.52800000000000002,"15min":0.52000000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.43099999999999999}]},{"osd":5,"last update":"Thu Feb 22 19:08:52 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52100000000000002,"15min":0.51300000000000001},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Feb 22 19:08:07 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Feb 22 19:08:28 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.51900000000000002}]}]},{"osd":2,"up_from":21,"seq":90194313256,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049024,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696128,"statfs":{"total":95995035648,"available":94920835072,"internally_reserved":1073741824,"allocated":450560,"data_stored":180198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 19:07:57 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35899999999999999,"15min":0.36199999999999999},"min":{"1min":0.217,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.54800000000000004,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.20799999999999999},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.378,"15min":0.376},"min":{"1min":0.22800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.64600000000000002,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Feb 22 19:07:57 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.375,"15min":0.373},"min":{"1min":0.26600000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.52300000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.313},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38900000000000001,"15min":0.39000000000000001},"min":{"1min":0.27700000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.23599999999999999}]},{"osd":3,"last update":"Thu Feb 22 19:08:13 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.38900000000000001,"15min":0.38800000000000001},"min":{"1min":0.22,"5min":0.22,"15min":0.22},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.40899999999999997,"15min":0.41099999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Feb 22 19:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65500000000000003,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.41699999999999998}]},{"osd":5,"last update":"Thu Feb 22 19:08:53 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52900000000000003,"15min":0.53500000000000003},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.748,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55100000000000005,"15min":0.55700000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73199999999999998,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.40799999999999997}]},{"osd":6,"last update":"Thu Feb 22 19:08:11 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.443},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.48999999999999999}]},{"osd":7,"last update":"Thu Feb 22 19:08:31 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"last":0.498},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.39300000000000002}]}]},{"osd":3,"up_from":26,"seq":111669149731,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 19:08:16 2024","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.34799999999999998,"15min":0.34999999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.251},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.40999999999999998,"15min":0.41299999999999998},"min":{"1min":0.25,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.28199999999999997}]},{"osd":1,"last update":"Thu Feb 22 19:08:16 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.39600000000000002,"15min":0.40000000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.218},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.25900000000000001}]},{"osd":2,"last update":"Thu Feb 22 19:08:16 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.318},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.42399999999999999,"15min":0.42599999999999999},"min":{"1min":0.27000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.27700000000000002}]},{"osd":4,"last update":"Thu Feb 22 19:08:29 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.39800000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.39100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.76000000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.35599999999999998}]},{"osd":5,"last update":"Thu Feb 22 19:08:53 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55400000000000005,"15min":0.55900000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.40200000000000002}]},{"osd":6,"last update":"Thu Feb 22 19:08:10 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.496},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.42499999999999999}]},{"osd":7,"last update":"Thu Feb 22 19:08:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.432},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47799999999999998}]}]},{"osd":4,"up_from":31,"seq":133143986207,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049024,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696128,"statfs":{"total":95995035648,"available":94920835072,"internally_reserved":1073741824,"allocated":450560,"data_stored":180198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.35599999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.34799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.67200000000000004,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46600000000000003,"15min":0.46800000000000003},"min":{"1min":0.315,"5min":0.31,"15min":0.31},"max":{"1min":0.61199999999999999,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.48099999999999998,"15min":0.48199999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.65100000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38300000000000001}]},{"osd":2,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.66300000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.47599999999999998,"15min":0.47799999999999998},"min":{"1min":0.32900000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.442}]},{"osd":3,"last update":"Thu Feb 22 19:08:32 2024","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52400000000000002,"15min":0.52900000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.64100000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48199999999999998,"15min":0.48099999999999998},"min":{"1min":0.35099999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.371}]},{"osd":5,"last update":"Thu Feb 22 19:07:54 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.314}]},{"osd":6,"last update":"Thu Feb 22 19:08:10 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.34100000000000003}]},{"osd":7,"last update":"Thu Feb 22 19:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.437},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.51700000000000002}]}]},{"osd":5,"up_from":36,"seq":154618822684,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049028,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696124,"statfs":{"total":95995035648,"available":94920830976,"internally_reserved":1073741824,"allocated":454656,"data_stored":180492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 22 19:08:51 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51900000000000002,"15min":0.52400000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70599999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.497,"15min":0.501},"min":{"1min":0.372,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.622,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.496}]},{"osd":1,"last update":"Thu Feb 22 19:08:51 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.51300000000000001,"15min":0.51600000000000001},"min":{"1min":0.36399999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69099999999999995,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.499,"15min":0.497},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.96099999999999997}]},{"osd":2,"last update":"Thu Feb 22 19:08:51 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72199999999999998,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.67200000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Feb 22 19:08:51 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.50600000000000001,"15min":0.51100000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.67900000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.374,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69199999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Feb 22 19:08:51 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.379,"15min":0.36899999999999999},"min":{"1min":0.27700000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.435,"5min":0.36299999999999999,"15min":0.35099999999999998},"min":{"1min":0.29199999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"last":0.77700000000000002}]},{"osd":6,"last update":"Thu Feb 22 19:08:08 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.752},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Feb 22 19:08:27 2024","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.74199999999999999}]}]}]}} 2024-02-22T19:08:58.804 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-22T19:08:58.804 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-22T19:08:58.804 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-22T19:08:58.805 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -- ceph health --format=json 2024-02-22T19:08:58.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:58 smithi063 bash[35391]: cluster 2024-02-22T19:08:57.487435+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:08:59.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:08:59 smithi062 bash[64101]: audit 2024-02-22T19:08:58.164750+0000 mgr.y (mgr.14140) 215 : audit [DBG] from='client.14589 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-22T19:08:59.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:08:59 smithi062 bash[67442]: audit 2024-02-22T19:08:58.164750+0000 mgr.y (mgr.14140) 215 : audit [DBG] from='client.14589 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-22T19:08:59.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:08:59 smithi063 bash[35391]: audit 2024-02-22T19:08:58.164750+0000 mgr.y (mgr.14140) 215 : audit [DBG] from='client.14589 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-22T19:09:00.781 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-22T19:09:00.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:00 smithi062 bash[64101]: cluster 2024-02-22T19:08:59.487727+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:00.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:00 smithi062 bash[67442]: cluster 2024-02-22T19:08:59.487727+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:00.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:00 smithi063 bash[35391]: cluster 2024-02-22T19:08:59.487727+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:01.359 INFO:teuthology.orchestra.run.smithi062.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-22T19:09:01.359 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-22T19:09:01.359 INFO:tasks.cephadm:Setup complete, yielding 2024-02-22T19:09:01.360 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-22T19:09:01.369 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi062.front.sepia.ceph.com 2024-02-22T19:09:01.370 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'radosgw-admin realm create --rgw-realm=r --default' 2024-02-22T19:09:01.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:01 smithi062 bash[64101]: audit 2024-02-22T19:09:00.780964+0000 mon.a (mon.0) 518 : audit [DBG] from='client.? 172.21.15.62:0/3553030664' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-22T19:09:01.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:01 smithi062 bash[67442]: audit 2024-02-22T19:09:00.780964+0000 mon.a (mon.0) 518 : audit [DBG] from='client.? 172.21.15.62:0/3553030664' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-22T19:09:01.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:01 smithi063 bash[35391]: audit 2024-02-22T19:09:00.780964+0000 mon.a (mon.0) 518 : audit [DBG] from='client.? 172.21.15.62:0/3553030664' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-22T19:09:02.598 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:02 smithi062 bash[64101]: cluster 2024-02-22T19:09:01.487986+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:02.598 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:02 smithi062 bash[67442]: cluster 2024-02-22T19:09:01.487986+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:02.652 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:02 smithi063 bash[35391]: cluster 2024-02-22T19:09:01.487986+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:04.602 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-22T19:09:04.602 INFO:teuthology.orchestra.run.smithi062.stdout: "id": "da4af5b9-2635-44a9-80e9-a4743ffe17b6", 2024-02-22T19:09:04.602 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "r", 2024-02-22T19:09:04.602 INFO:teuthology.orchestra.run.smithi062.stdout: "current_period": "f6b634ca-b776-4724-92e8-6bc63b30d150", 2024-02-22T19:09:04.602 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 1 2024-02-22T19:09:04.603 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-22T19:09:04.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:04 smithi063 bash[35391]: cluster 2024-02-22T19:09:03.488514+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:04.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:04 smithi063 bash[35391]: cluster 2024-02-22T19:09:03.550263+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2024-02-22T19:09:04.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:04 smithi063 bash[35391]: audit 2024-02-22T19:09:03.552007+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.62:0/2726146288' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-22T19:09:04.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:04 smithi063 bash[35391]: audit 2024-02-22T19:09:03.554630+0000 mon.a (mon.0) 520 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-22T19:09:04.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:04 smithi063 bash[35391]: audit 2024-02-22T19:09:04.301749+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300500\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300586\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300622\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300672\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300705\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300737\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300768\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300798\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300829\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_daemon_update\": \"2024-02-22T19:09:04.300914\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:09:04.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:04 smithi063 bash[35391]: audit 2024-02-22T19:09:04.304831+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300500\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300586\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300622\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300672\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300705\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300737\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300768\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300798\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300829\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_daemon_update\": \"2024-02-22T19:09:04.300914\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:09:04.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:04 smithi063 bash[35391]: audit 2024-02-22T19:09:04.307039+0000 mon.a (mon.0) 523 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:09:04.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:04 smithi062 bash[64101]: cluster 2024-02-22T19:09:03.488514+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:04.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:04 smithi062 bash[64101]: cluster 2024-02-22T19:09:03.550263+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2024-02-22T19:09:04.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:04 smithi062 bash[64101]: audit 2024-02-22T19:09:03.552007+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.62:0/2726146288' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-22T19:09:04.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:04 smithi062 bash[64101]: audit 2024-02-22T19:09:03.554630+0000 mon.a (mon.0) 520 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-22T19:09:04.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:04 smithi062 bash[67442]: cluster 2024-02-22T19:09:03.488514+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:04.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:04 smithi062 bash[67442]: cluster 2024-02-22T19:09:03.550263+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2024-02-22T19:09:04.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:04 smithi062 bash[67442]: audit 2024-02-22T19:09:03.552007+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.62:0/2726146288' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-22T19:09:04.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:04 smithi062 bash[67442]: audit 2024-02-22T19:09:03.554630+0000 mon.a (mon.0) 520 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-22T19:09:04.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:04 smithi062 bash[64101]: audit 2024-02-22T19:09:04.301749+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300500\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300586\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300622\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300672\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300705\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300737\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300768\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300798\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300829\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_daemon_update\": \"2024-02-22T19:09:04.300914\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:09:04.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:04 smithi062 bash[64101]: audit 2024-02-22T19:09:04.304831+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300500\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300586\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300622\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300672\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300705\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300737\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300768\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300798\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300829\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_daemon_update\": \"2024-02-22T19:09:04.300914\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:09:04.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:04 smithi062 bash[64101]: audit 2024-02-22T19:09:04.307039+0000 mon.a (mon.0) 523 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:09:04.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:04 smithi062 bash[67442]: audit 2024-02-22T19:09:04.301749+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300500\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300586\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300622\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300672\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300705\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300737\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300768\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300798\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300829\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_daemon_update\": \"2024-02-22T19:09:04.300914\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:09:04.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:04 smithi062 bash[67442]: audit 2024-02-22T19:09:04.304831+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300500\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300586\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300622\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300672\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300705\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300737\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300768\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300798\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:04.300829\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_daemon_update\": \"2024-02-22T19:09:04.300914\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:09:04.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:04 smithi062 bash[67442]: audit 2024-02-22T19:09:04.307039+0000 mon.a (mon.0) 523 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:09:05.874 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:05 smithi062 bash[64101]: audit 2024-02-22T19:09:04.552916+0000 mon.a (mon.0) 524 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-22T19:09:05.874 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:05 smithi062 bash[64101]: cluster 2024-02-22T19:09:04.552985+0000 mon.a (mon.0) 525 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-02-22T19:09:05.875 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:05 smithi062 bash[67442]: audit 2024-02-22T19:09:04.552916+0000 mon.a (mon.0) 524 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-22T19:09:05.875 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:05 smithi062 bash[67442]: cluster 2024-02-22T19:09:04.552985+0000 mon.a (mon.0) 525 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-02-22T19:09:05.885 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'radosgw-admin zonegroup create --rgw-zonegroup=default --master --default' 2024-02-22T19:09:05.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:05 smithi063 bash[35391]: audit 2024-02-22T19:09:04.552916+0000 mon.a (mon.0) 524 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-22T19:09:05.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:05 smithi063 bash[35391]: cluster 2024-02-22T19:09:04.552985+0000 mon.a (mon.0) 525 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2024-02-22T19:09:06.874 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:06 smithi062 bash[64101]: cluster 2024-02-22T19:09:05.488858+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v207: 33 pgs: 5 creating+peering, 1 active+clean, 27 unknown; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:06.874 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:06 smithi062 bash[64101]: cluster 2024-02-22T19:09:05.565055+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-02-22T19:09:06.874 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:06 smithi062 bash[67442]: cluster 2024-02-22T19:09:05.488858+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v207: 33 pgs: 5 creating+peering, 1 active+clean, 27 unknown; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:06.874 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:06 smithi062 bash[67442]: cluster 2024-02-22T19:09:05.565055+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-02-22T19:09:06.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:06 smithi063 bash[35391]: cluster 2024-02-22T19:09:05.488858+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v207: 33 pgs: 5 creating+peering, 1 active+clean, 27 unknown; 0 B data, 3.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:06.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:06 smithi063 bash[35391]: cluster 2024-02-22T19:09:05.565055+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-02-22T19:09:07.837 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-22T19:09:07.837 INFO:teuthology.orchestra.run.smithi062.stdout: "id": "8b5d5310-df02-4857-b3c4-9ca832572758", 2024-02-22T19:09:07.837 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "default", 2024-02-22T19:09:07.837 INFO:teuthology.orchestra.run.smithi062.stdout: "api_name": "default", 2024-02-22T19:09:07.838 INFO:teuthology.orchestra.run.smithi062.stdout: "is_master": "true", 2024-02-22T19:09:07.838 INFO:teuthology.orchestra.run.smithi062.stdout: "endpoints": [], 2024-02-22T19:09:07.838 INFO:teuthology.orchestra.run.smithi062.stdout: "hostnames": [], 2024-02-22T19:09:07.838 INFO:teuthology.orchestra.run.smithi062.stdout: "hostnames_s3website": [], 2024-02-22T19:09:07.838 INFO:teuthology.orchestra.run.smithi062.stdout: "master_zone": "", 2024-02-22T19:09:07.838 INFO:teuthology.orchestra.run.smithi062.stdout: "zones": [], 2024-02-22T19:09:07.838 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_targets": [], 2024-02-22T19:09:07.838 INFO:teuthology.orchestra.run.smithi062.stdout: "default_placement": "", 2024-02-22T19:09:07.838 INFO:teuthology.orchestra.run.smithi062.stdout: "realm_id": "da4af5b9-2635-44a9-80e9-a4743ffe17b6", 2024-02-22T19:09:07.838 INFO:teuthology.orchestra.run.smithi062.stdout: "sync_policy": { 2024-02-22T19:09:07.838 INFO:teuthology.orchestra.run.smithi062.stdout: "groups": [] 2024-02-22T19:09:07.838 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-02-22T19:09:07.838 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-22T19:09:08.542 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default' 2024-02-22T19:09:08.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:08 smithi063 bash[35391]: cluster 2024-02-22T19:09:07.489161+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v209: 33 pgs: 5 creating+peering, 17 active+clean, 11 unknown; 436 B data, 3.6 MiB used, 707 GiB / 715 GiB avail; 1023 B/s wr, 1 op/s 2024-02-22T19:09:08.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:08 smithi062 bash[64101]: cluster 2024-02-22T19:09:07.489161+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v209: 33 pgs: 5 creating+peering, 17 active+clean, 11 unknown; 436 B data, 3.6 MiB used, 707 GiB / 715 GiB avail; 1023 B/s wr, 1 op/s 2024-02-22T19:09:08.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:08 smithi062 bash[67442]: cluster 2024-02-22T19:09:07.489161+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v209: 33 pgs: 5 creating+peering, 17 active+clean, 11 unknown; 436 B data, 3.6 MiB used, 707 GiB / 715 GiB avail; 1023 B/s wr, 1 op/s 2024-02-22T19:09:10.634 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:10 smithi062 bash[64101]: cluster 2024-02-22T19:09:09.489682+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v210: 33 pgs: 33 active+clean; 608 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s wr, 2 op/s 2024-02-22T19:09:10.635 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:10 smithi062 bash[67442]: cluster 2024-02-22T19:09:09.489682+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v210: 33 pgs: 33 active+clean; 608 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s wr, 2 op/s 2024-02-22T19:09:10.876 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-22T19:09:10.876 INFO:teuthology.orchestra.run.smithi062.stdout: "id": "c830e866-53a1-45ae-a66a-5224a3ccac6e", 2024-02-22T19:09:10.876 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "z", 2024-02-22T19:09:10.876 INFO:teuthology.orchestra.run.smithi062.stdout: "domain_root": "z.rgw.meta:root", 2024-02-22T19:09:10.876 INFO:teuthology.orchestra.run.smithi062.stdout: "control_pool": "z.rgw.control", 2024-02-22T19:09:10.876 INFO:teuthology.orchestra.run.smithi062.stdout: "gc_pool": "z.rgw.log:gc", 2024-02-22T19:09:10.876 INFO:teuthology.orchestra.run.smithi062.stdout: "lc_pool": "z.rgw.log:lc", 2024-02-22T19:09:10.876 INFO:teuthology.orchestra.run.smithi062.stdout: "log_pool": "z.rgw.log", 2024-02-22T19:09:10.877 INFO:teuthology.orchestra.run.smithi062.stdout: "intent_log_pool": "z.rgw.log:intent", 2024-02-22T19:09:10.877 INFO:teuthology.orchestra.run.smithi062.stdout: "usage_log_pool": "z.rgw.log:usage", 2024-02-22T19:09:10.877 INFO:teuthology.orchestra.run.smithi062.stdout: "roles_pool": "z.rgw.meta:roles", 2024-02-22T19:09:10.877 INFO:teuthology.orchestra.run.smithi062.stdout: "reshard_pool": "z.rgw.log:reshard", 2024-02-22T19:09:10.877 INFO:teuthology.orchestra.run.smithi062.stdout: "user_keys_pool": "z.rgw.meta:users.keys", 2024-02-22T19:09:10.877 INFO:teuthology.orchestra.run.smithi062.stdout: "user_email_pool": "z.rgw.meta:users.email", 2024-02-22T19:09:10.877 INFO:teuthology.orchestra.run.smithi062.stdout: "user_swift_pool": "z.rgw.meta:users.swift", 2024-02-22T19:09:10.877 INFO:teuthology.orchestra.run.smithi062.stdout: "user_uid_pool": "z.rgw.meta:users.uid", 2024-02-22T19:09:10.877 INFO:teuthology.orchestra.run.smithi062.stdout: "otp_pool": "z.rgw.otp", 2024-02-22T19:09:10.877 INFO:teuthology.orchestra.run.smithi062.stdout: "system_key": { 2024-02-22T19:09:10.877 INFO:teuthology.orchestra.run.smithi062.stdout: "access_key": "", 2024-02-22T19:09:10.878 INFO:teuthology.orchestra.run.smithi062.stdout: "secret_key": "" 2024-02-22T19:09:10.878 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:09:10.878 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_pools": [ 2024-02-22T19:09:10.878 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-02-22T19:09:10.878 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "default-placement", 2024-02-22T19:09:10.878 INFO:teuthology.orchestra.run.smithi062.stdout: "val": { 2024-02-22T19:09:10.878 INFO:teuthology.orchestra.run.smithi062.stdout: "index_pool": "z.rgw.buckets.index", 2024-02-22T19:09:10.878 INFO:teuthology.orchestra.run.smithi062.stdout: "storage_classes": { 2024-02-22T19:09:10.878 INFO:teuthology.orchestra.run.smithi062.stdout: "STANDARD": { 2024-02-22T19:09:10.878 INFO:teuthology.orchestra.run.smithi062.stdout: "data_pool": "z.rgw.buckets.data" 2024-02-22T19:09:10.878 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-02-22T19:09:10.878 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:09:10.878 INFO:teuthology.orchestra.run.smithi062.stdout: "data_extra_pool": "z.rgw.buckets.non-ec", 2024-02-22T19:09:10.879 INFO:teuthology.orchestra.run.smithi062.stdout: "index_type": 0 2024-02-22T19:09:10.879 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-02-22T19:09:10.879 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-02-22T19:09:10.879 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-02-22T19:09:10.879 INFO:teuthology.orchestra.run.smithi062.stdout: "realm_id": "da4af5b9-2635-44a9-80e9-a4743ffe17b6" 2024-02-22T19:09:10.879 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-22T19:09:10.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:10 smithi063 bash[35391]: cluster 2024-02-22T19:09:09.489682+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v210: 33 pgs: 33 active+clean; 608 B data, 3.8 MiB used, 707 GiB / 715 GiB avail; 1.7 KiB/s wr, 2 op/s 2024-02-22T19:09:11.563 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'radosgw-admin period update --rgw-realm=r --commit' 2024-02-22T19:09:11.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:11 smithi063 bash[35391]: cluster 2024-02-22T19:09:11.490038+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v211: 33 pgs: 33 active+clean; 996 B data, 3.9 MiB used, 707 GiB / 715 GiB avail; 386 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-22T19:09:11.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:11 smithi062 bash[64101]: cluster 2024-02-22T19:09:11.490038+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v211: 33 pgs: 33 active+clean; 996 B data, 3.9 MiB used, 707 GiB / 715 GiB avail; 386 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-22T19:09:11.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:11 smithi062 bash[67442]: cluster 2024-02-22T19:09:11.490038+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v211: 33 pgs: 33 active+clean; 996 B data, 3.9 MiB used, 707 GiB / 715 GiB avail; 386 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-22T19:09:12.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:12 smithi063 bash[35391]: audit 2024-02-22T19:09:11.877304+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876185\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876259\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876293\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876325\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876354\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876384\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876414\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876444\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876474\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}}, \"last_daemon_update\": \"2024-02-22T19:09:11.876546\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:09:12.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:12 smithi063 bash[35391]: audit 2024-02-22T19:09:11.880419+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876185\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876259\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876293\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876325\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876354\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876384\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876414\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876444\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876474\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}}, \"last_daemon_update\": \"2024-02-22T19:09:11.876546\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:09:12.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:12 smithi063 bash[35391]: audit 2024-02-22T19:09:11.880974+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:09:12.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:12 smithi062 bash[64101]: audit 2024-02-22T19:09:11.877304+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876185\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876259\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876293\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876325\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876354\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876384\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876414\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876444\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876474\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}}, \"last_daemon_update\": \"2024-02-22T19:09:11.876546\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:09:12.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:12 smithi062 bash[64101]: audit 2024-02-22T19:09:11.880419+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876185\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876259\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876293\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876325\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876354\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876384\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876414\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876444\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876474\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}}, \"last_daemon_update\": \"2024-02-22T19:09:11.876546\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:09:12.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:12 smithi062 bash[64101]: audit 2024-02-22T19:09:11.880974+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:09:12.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:12 smithi062 bash[67442]: audit 2024-02-22T19:09:11.877304+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876185\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876259\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876293\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876325\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876354\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876384\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876414\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876444\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876474\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}}, \"last_daemon_update\": \"2024-02-22T19:09:11.876546\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:09:12.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:12 smithi062 bash[67442]: audit 2024-02-22T19:09:11.880419+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876185\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876259\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876293\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876325\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876354\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876384\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876414\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876444\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876474\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}}, \"last_daemon_update\": \"2024-02-22T19:09:11.876546\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:09:12.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:12 smithi062 bash[67442]: audit 2024-02-22T19:09:11.880974+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:09:14.298 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:14 smithi063 bash[35391]: cluster 2024-02-22T19:09:13.490456+0000 mgr.y (mgr.14140) 223 : cluster [DBG] pgmap v212: 33 pgs: 33 active+clean; 1.0 KiB data, 3.9 MiB used, 707 GiB / 715 GiB avail; 458 B/s rd, 1.6 KiB/s wr, 2 op/s 2024-02-22T19:09:14.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:14 smithi062 bash[64101]: cluster 2024-02-22T19:09:13.490456+0000 mgr.y (mgr.14140) 223 : cluster [DBG] pgmap v212: 33 pgs: 33 active+clean; 1.0 KiB data, 3.9 MiB used, 707 GiB / 715 GiB avail; 458 B/s rd, 1.6 KiB/s wr, 2 op/s 2024-02-22T19:09:14.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:14 smithi062 bash[67442]: cluster 2024-02-22T19:09:13.490456+0000 mgr.y (mgr.14140) 223 : cluster [DBG] pgmap v212: 33 pgs: 33 active+clean; 1.0 KiB data, 3.9 MiB used, 707 GiB / 715 GiB avail; 458 B/s rd, 1.6 KiB/s wr, 2 op/s 2024-02-22T19:09:15.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:15 smithi063 bash[35391]: cluster 2024-02-22T19:09:14.053220+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-02-22T19:09:15.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:15 smithi063 bash[35391]: audit 2024-02-22T19:09:14.057377+0000 mon.a (mon.0) 531 : audit [INF] from='client.? 172.21.15.62:0/58176799' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-02-22T19:09:15.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:15 smithi063 bash[35391]: audit 2024-02-22T19:09:15.053771+0000 mon.a (mon.0) 532 : audit [INF] from='client.? 172.21.15.62:0/58176799' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-02-22T19:09:15.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:15 smithi063 bash[35391]: cluster 2024-02-22T19:09:15.053837+0000 mon.a (mon.0) 533 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-02-22T19:09:15.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:15 smithi062 bash[64101]: cluster 2024-02-22T19:09:14.053220+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-02-22T19:09:15.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:15 smithi062 bash[64101]: audit 2024-02-22T19:09:14.057377+0000 mon.a (mon.0) 531 : audit [INF] from='client.? 172.21.15.62:0/58176799' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-02-22T19:09:15.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:15 smithi062 bash[64101]: audit 2024-02-22T19:09:15.053771+0000 mon.a (mon.0) 532 : audit [INF] from='client.? 172.21.15.62:0/58176799' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-02-22T19:09:15.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:15 smithi062 bash[64101]: cluster 2024-02-22T19:09:15.053837+0000 mon.a (mon.0) 533 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-02-22T19:09:15.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:15 smithi062 bash[67442]: cluster 2024-02-22T19:09:14.053220+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-02-22T19:09:15.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:15 smithi062 bash[67442]: audit 2024-02-22T19:09:14.057377+0000 mon.a (mon.0) 531 : audit [INF] from='client.? 172.21.15.62:0/58176799' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-02-22T19:09:15.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:15 smithi062 bash[67442]: audit 2024-02-22T19:09:15.053771+0000 mon.a (mon.0) 532 : audit [INF] from='client.? 172.21.15.62:0/58176799' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-02-22T19:09:15.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:15 smithi062 bash[67442]: cluster 2024-02-22T19:09:15.053837+0000 mon.a (mon.0) 533 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-02-22T19:09:16.366 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:16 smithi063 bash[35391]: cluster 2024-02-22T19:09:15.490718+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v215: 65 pgs: 32 unknown, 33 active+clean; 1.0 KiB data, 3.9 MiB used, 707 GiB / 715 GiB avail; 511 B/s rd, 1023 B/s wr, 1 op/s 2024-02-22T19:09:16.366 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:16 smithi063 bash[35391]: audit 2024-02-22T19:09:15.505468+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196385\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196461\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196495\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196525\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196555\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196584\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196614\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196655\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196686\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_daemon_update\": \"2024-02-22T19:09:15.196765\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:09:16.366 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:16 smithi063 bash[35391]: audit 2024-02-22T19:09:15.512875+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196385\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196461\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196495\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196525\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196555\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196584\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196614\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196655\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196686\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_daemon_update\": \"2024-02-22T19:09:15.196765\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:09:16.366 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:16 smithi063 bash[35391]: cluster 2024-02-22T19:09:16.056711+0000 mon.a (mon.0) 536 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-02-22T19:09:16.367 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:16 smithi063 bash[35391]: audit 2024-02-22T19:09:16.059017+0000 mon.a (mon.0) 537 : audit [INF] from='client.? 172.21.15.62:0/58176799' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-02-22T19:09:16.386 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:16 smithi062 bash[64101]: cluster 2024-02-22T19:09:15.490718+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v215: 65 pgs: 32 unknown, 33 active+clean; 1.0 KiB data, 3.9 MiB used, 707 GiB / 715 GiB avail; 511 B/s rd, 1023 B/s wr, 1 op/s 2024-02-22T19:09:16.386 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:16 smithi062 bash[67442]: cluster 2024-02-22T19:09:15.490718+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v215: 65 pgs: 32 unknown, 33 active+clean; 1.0 KiB data, 3.9 MiB used, 707 GiB / 715 GiB avail; 511 B/s rd, 1023 B/s wr, 1 op/s 2024-02-22T19:09:16.387 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:16 smithi062 bash[64101]: audit 2024-02-22T19:09:15.505468+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196385\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196461\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196495\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196525\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196555\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196584\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196614\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196655\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196686\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_daemon_update\": \"2024-02-22T19:09:15.196765\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:09:16.387 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:16 smithi062 bash[64101]: audit 2024-02-22T19:09:15.512875+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196385\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196461\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196495\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196525\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196555\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196584\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196614\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196655\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196686\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_daemon_update\": \"2024-02-22T19:09:15.196765\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:09:16.387 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:16 smithi062 bash[64101]: cluster 2024-02-22T19:09:16.056711+0000 mon.a (mon.0) 536 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-02-22T19:09:16.387 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:16 smithi062 bash[64101]: audit 2024-02-22T19:09:16.059017+0000 mon.a (mon.0) 537 : audit [INF] from='client.? 172.21.15.62:0/58176799' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-02-22T19:09:16.387 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:16 smithi062 bash[67442]: audit 2024-02-22T19:09:15.505468+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196385\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196461\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196495\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196525\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196555\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196584\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196614\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196655\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196686\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_daemon_update\": \"2024-02-22T19:09:15.196765\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:09:16.387 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:16 smithi062 bash[67442]: audit 2024-02-22T19:09:15.512875+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196385\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196461\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196495\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196525\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196555\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196584\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196614\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196655\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196686\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}}, \"last_daemon_update\": \"2024-02-22T19:09:15.196765\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:09:16.387 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:16 smithi062 bash[67442]: cluster 2024-02-22T19:09:16.056711+0000 mon.a (mon.0) 536 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-02-22T19:09:16.387 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:16 smithi062 bash[67442]: audit 2024-02-22T19:09:16.059017+0000 mon.a (mon.0) 537 : audit [INF] from='client.? 172.21.15.62:0/58176799' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-02-22T19:09:18.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:18 smithi063 bash[35391]: audit 2024-02-22T19:09:17.057650+0000 mon.a (mon.0) 538 : audit [INF] from='client.? 172.21.15.62:0/58176799' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-02-22T19:09:18.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:18 smithi063 bash[35391]: cluster 2024-02-22T19:09:17.057814+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-02-22T19:09:18.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:18 smithi063 bash[35391]: cluster 2024-02-22T19:09:17.491250+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v218: 97 pgs: 44 unknown, 53 active+clean; 1.8 KiB data, 4.0 MiB used, 707 GiB / 715 GiB avail; 3.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-22T19:09:18.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:18 smithi062 bash[64101]: audit 2024-02-22T19:09:17.057650+0000 mon.a (mon.0) 538 : audit [INF] from='client.? 172.21.15.62:0/58176799' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-02-22T19:09:18.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:18 smithi062 bash[64101]: cluster 2024-02-22T19:09:17.057814+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-02-22T19:09:18.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:18 smithi062 bash[64101]: cluster 2024-02-22T19:09:17.491250+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v218: 97 pgs: 44 unknown, 53 active+clean; 1.8 KiB data, 4.0 MiB used, 707 GiB / 715 GiB avail; 3.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-22T19:09:18.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:18 smithi062 bash[67442]: audit 2024-02-22T19:09:17.057650+0000 mon.a (mon.0) 538 : audit [INF] from='client.? 172.21.15.62:0/58176799' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-02-22T19:09:18.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:18 smithi062 bash[67442]: cluster 2024-02-22T19:09:17.057814+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-02-22T19:09:18.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:18 smithi062 bash[67442]: cluster 2024-02-22T19:09:17.491250+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v218: 97 pgs: 44 unknown, 53 active+clean; 1.8 KiB data, 4.0 MiB used, 707 GiB / 715 GiB avail; 3.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-22T19:09:19.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:19 smithi063 bash[35391]: cluster 2024-02-22T19:09:18.441783+0000 mon.a (mon.0) 540 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-22T19:09:19.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:19 smithi063 bash[35391]: audit 2024-02-22T19:09:18.442777+0000 mon.a (mon.0) 541 : audit [INF] from='client.? 172.21.15.62:0/3172728709' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-02-22T19:09:19.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:19 smithi062 bash[64101]: cluster 2024-02-22T19:09:18.441783+0000 mon.a (mon.0) 540 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-22T19:09:19.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:19 smithi062 bash[64101]: audit 2024-02-22T19:09:18.442777+0000 mon.a (mon.0) 541 : audit [INF] from='client.? 172.21.15.62:0/3172728709' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-02-22T19:09:19.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:19 smithi062 bash[67442]: cluster 2024-02-22T19:09:18.441783+0000 mon.a (mon.0) 540 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-22T19:09:19.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:19 smithi062 bash[67442]: audit 2024-02-22T19:09:18.442777+0000 mon.a (mon.0) 541 : audit [INF] from='client.? 172.21.15.62:0/3172728709' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-02-22T19:09:20.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:20 smithi063 bash[35391]: audit 2024-02-22T19:09:19.441029+0000 mon.a (mon.0) 542 : audit [INF] from='client.? 172.21.15.62:0/3172728709' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-02-22T19:09:20.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:20 smithi063 bash[35391]: cluster 2024-02-22T19:09:19.441244+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-22T19:09:20.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:20 smithi063 bash[35391]: audit 2024-02-22T19:09:19.448931+0000 mon.a (mon.0) 544 : audit [INF] from='client.? 172.21.15.62:0/3172728709' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-22T19:09:20.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:20 smithi063 bash[35391]: cluster 2024-02-22T19:09:19.491839+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v221: 129 pgs: 12 creating+peering, 39 unknown, 78 active+clean; 1.8 KiB data, 4.2 MiB used, 707 GiB / 715 GiB avail; 4.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-22T19:09:20.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:20 smithi063 bash[35391]: audit 2024-02-22T19:09:20.444465+0000 mon.a (mon.0) 545 : audit [INF] from='client.? 172.21.15.62:0/3172728709' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-22T19:09:20.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:20 smithi063 bash[35391]: cluster 2024-02-22T19:09:20.444514+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-22T19:09:20.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:20 smithi063 bash[35391]: audit 2024-02-22T19:09:20.444997+0000 mon.a (mon.0) 547 : audit [INF] from='client.? 172.21.15.62:0/3172728709' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-02-22T19:09:20.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:20 smithi062 bash[64101]: audit 2024-02-22T19:09:19.441029+0000 mon.a (mon.0) 542 : audit [INF] from='client.? 172.21.15.62:0/3172728709' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-02-22T19:09:20.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:20 smithi062 bash[64101]: cluster 2024-02-22T19:09:19.441244+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-22T19:09:20.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:20 smithi062 bash[64101]: audit 2024-02-22T19:09:19.448931+0000 mon.a (mon.0) 544 : audit [INF] from='client.? 172.21.15.62:0/3172728709' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-22T19:09:20.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:20 smithi062 bash[64101]: cluster 2024-02-22T19:09:19.491839+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v221: 129 pgs: 12 creating+peering, 39 unknown, 78 active+clean; 1.8 KiB data, 4.2 MiB used, 707 GiB / 715 GiB avail; 4.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-22T19:09:20.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:20 smithi062 bash[64101]: audit 2024-02-22T19:09:20.444465+0000 mon.a (mon.0) 545 : audit [INF] from='client.? 172.21.15.62:0/3172728709' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-22T19:09:20.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:20 smithi062 bash[64101]: cluster 2024-02-22T19:09:20.444514+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-22T19:09:20.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:20 smithi062 bash[64101]: audit 2024-02-22T19:09:20.444997+0000 mon.a (mon.0) 547 : audit [INF] from='client.? 172.21.15.62:0/3172728709' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-02-22T19:09:20.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:20 smithi062 bash[67442]: audit 2024-02-22T19:09:19.441029+0000 mon.a (mon.0) 542 : audit [INF] from='client.? 172.21.15.62:0/3172728709' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-02-22T19:09:20.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:20 smithi062 bash[67442]: cluster 2024-02-22T19:09:19.441244+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-22T19:09:20.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:20 smithi062 bash[67442]: audit 2024-02-22T19:09:19.448931+0000 mon.a (mon.0) 544 : audit [INF] from='client.? 172.21.15.62:0/3172728709' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-22T19:09:20.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:20 smithi062 bash[67442]: cluster 2024-02-22T19:09:19.491839+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v221: 129 pgs: 12 creating+peering, 39 unknown, 78 active+clean; 1.8 KiB data, 4.2 MiB used, 707 GiB / 715 GiB avail; 4.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-22T19:09:20.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:20 smithi062 bash[67442]: audit 2024-02-22T19:09:20.444465+0000 mon.a (mon.0) 545 : audit [INF] from='client.? 172.21.15.62:0/3172728709' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-22T19:09:20.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:20 smithi062 bash[67442]: cluster 2024-02-22T19:09:20.444514+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-22T19:09:20.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:20 smithi062 bash[67442]: audit 2024-02-22T19:09:20.444997+0000 mon.a (mon.0) 547 : audit [INF] from='client.? 172.21.15.62:0/3172728709' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-02-22T19:09:21.536 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-22T19:09:21.536 INFO:teuthology.orchestra.run.smithi062.stdout: "id": "096f1987-4cdd-4050-b27b-ab1046c6e5ac", 2024-02-22T19:09:21.536 INFO:teuthology.orchestra.run.smithi062.stdout: "epoch": 1, 2024-02-22T19:09:21.536 INFO:teuthology.orchestra.run.smithi062.stdout: "predecessor_uuid": "f6b634ca-b776-4724-92e8-6bc63b30d150", 2024-02-22T19:09:21.536 INFO:teuthology.orchestra.run.smithi062.stdout: "sync_status": [], 2024-02-22T19:09:21.537 INFO:teuthology.orchestra.run.smithi062.stdout: "period_map": { 2024-02-22T19:09:21.537 INFO:teuthology.orchestra.run.smithi062.stdout: "id": "096f1987-4cdd-4050-b27b-ab1046c6e5ac", 2024-02-22T19:09:21.537 INFO:teuthology.orchestra.run.smithi062.stdout: "zonegroups": [ 2024-02-22T19:09:21.537 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-02-22T19:09:21.537 INFO:teuthology.orchestra.run.smithi062.stdout: "id": "8b5d5310-df02-4857-b3c4-9ca832572758", 2024-02-22T19:09:21.537 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "default", 2024-02-22T19:09:21.537 INFO:teuthology.orchestra.run.smithi062.stdout: "api_name": "default", 2024-02-22T19:09:21.537 INFO:teuthology.orchestra.run.smithi062.stdout: "is_master": "true", 2024-02-22T19:09:21.537 INFO:teuthology.orchestra.run.smithi062.stdout: "endpoints": [], 2024-02-22T19:09:21.537 INFO:teuthology.orchestra.run.smithi062.stdout: "hostnames": [], 2024-02-22T19:09:21.537 INFO:teuthology.orchestra.run.smithi062.stdout: "hostnames_s3website": [], 2024-02-22T19:09:21.537 INFO:teuthology.orchestra.run.smithi062.stdout: "master_zone": "c830e866-53a1-45ae-a66a-5224a3ccac6e", 2024-02-22T19:09:21.537 INFO:teuthology.orchestra.run.smithi062.stdout: "zones": [ 2024-02-22T19:09:21.537 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-02-22T19:09:21.537 INFO:teuthology.orchestra.run.smithi062.stdout: "id": "c830e866-53a1-45ae-a66a-5224a3ccac6e", 2024-02-22T19:09:21.538 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "z", 2024-02-22T19:09:21.538 INFO:teuthology.orchestra.run.smithi062.stdout: "endpoints": [], 2024-02-22T19:09:21.538 INFO:teuthology.orchestra.run.smithi062.stdout: "log_meta": "false", 2024-02-22T19:09:21.538 INFO:teuthology.orchestra.run.smithi062.stdout: "log_data": "false", 2024-02-22T19:09:21.538 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_index_max_shards": 11, 2024-02-22T19:09:21.538 INFO:teuthology.orchestra.run.smithi062.stdout: "read_only": "false", 2024-02-22T19:09:21.538 INFO:teuthology.orchestra.run.smithi062.stdout: "tier_type": "", 2024-02-22T19:09:21.538 INFO:teuthology.orchestra.run.smithi062.stdout: "sync_from_all": "true", 2024-02-22T19:09:21.538 INFO:teuthology.orchestra.run.smithi062.stdout: "sync_from": [], 2024-02-22T19:09:21.538 INFO:teuthology.orchestra.run.smithi062.stdout: "redirect_zone": "" 2024-02-22T19:09:21.538 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-02-22T19:09:21.538 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-02-22T19:09:21.538 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_targets": [ 2024-02-22T19:09:21.538 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-02-22T19:09:21.538 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "default-placement", 2024-02-22T19:09:21.538 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-02-22T19:09:21.538 INFO:teuthology.orchestra.run.smithi062.stdout: "storage_classes": [ 2024-02-22T19:09:21.539 INFO:teuthology.orchestra.run.smithi062.stdout: "STANDARD" 2024-02-22T19:09:21.539 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-02-22T19:09:21.539 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-02-22T19:09:21.539 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-02-22T19:09:21.539 INFO:teuthology.orchestra.run.smithi062.stdout: "default_placement": "default-placement", 2024-02-22T19:09:21.539 INFO:teuthology.orchestra.run.smithi062.stdout: "realm_id": "da4af5b9-2635-44a9-80e9-a4743ffe17b6", 2024-02-22T19:09:21.539 INFO:teuthology.orchestra.run.smithi062.stdout: "sync_policy": { 2024-02-22T19:09:21.539 INFO:teuthology.orchestra.run.smithi062.stdout: "groups": [] 2024-02-22T19:09:21.539 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-02-22T19:09:21.539 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-02-22T19:09:21.539 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-02-22T19:09:21.539 INFO:teuthology.orchestra.run.smithi062.stdout: "short_zone_ids": [ 2024-02-22T19:09:21.539 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-02-22T19:09:21.539 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "c830e866-53a1-45ae-a66a-5224a3ccac6e", 2024-02-22T19:09:21.539 INFO:teuthology.orchestra.run.smithi062.stdout: "val": 1845653638 2024-02-22T19:09:21.539 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-02-22T19:09:21.540 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-02-22T19:09:21.540 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:09:21.540 INFO:teuthology.orchestra.run.smithi062.stdout: "master_zonegroup": "8b5d5310-df02-4857-b3c4-9ca832572758", 2024-02-22T19:09:21.540 INFO:teuthology.orchestra.run.smithi062.stdout: "master_zone": "c830e866-53a1-45ae-a66a-5224a3ccac6e", 2024-02-22T19:09:21.540 INFO:teuthology.orchestra.run.smithi062.stdout: "period_config": { 2024-02-22T19:09:21.540 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2024-02-22T19:09:21.540 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-02-22T19:09:21.540 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-02-22T19:09:21.540 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-02-22T19:09:21.540 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-02-22T19:09:21.540 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-02-22T19:09:21.540 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:09:21.540 INFO:teuthology.orchestra.run.smithi062.stdout: "user_quota": { 2024-02-22T19:09:21.540 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-02-22T19:09:21.540 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-02-22T19:09:21.540 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-02-22T19:09:21.541 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-02-22T19:09:21.541 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-02-22T19:09:21.541 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-02-22T19:09:21.541 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:09:21.541 INFO:teuthology.orchestra.run.smithi062.stdout: "realm_id": "da4af5b9-2635-44a9-80e9-a4743ffe17b6", 2024-02-22T19:09:21.541 INFO:teuthology.orchestra.run.smithi062.stdout: "realm_name": "r", 2024-02-22T19:09:21.541 INFO:teuthology.orchestra.run.smithi062.stdout: "realm_epoch": 2 2024-02-22T19:09:21.541 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-22T19:09:22.296 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph orch apply rgw r z --placement=2 --port=8000' 2024-02-22T19:09:22.677 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:22 smithi062 bash[64101]: audit 2024-02-22T19:09:21.444665+0000 mon.a (mon.0) 548 : audit [INF] from='client.? 172.21.15.62:0/3172728709' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-02-22T19:09:22.677 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:22 smithi062 bash[64101]: cluster 2024-02-22T19:09:21.444726+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-22T19:09:22.677 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:22 smithi062 bash[64101]: cluster 2024-02-22T19:09:21.492157+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v224: 129 pgs: 12 creating+peering, 4 unknown, 113 active+clean; 1.8 KiB data, 4.4 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-22T19:09:22.678 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:22 smithi062 bash[67442]: audit 2024-02-22T19:09:21.444665+0000 mon.a (mon.0) 548 : audit [INF] from='client.? 172.21.15.62:0/3172728709' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-02-22T19:09:22.678 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:22 smithi062 bash[67442]: cluster 2024-02-22T19:09:21.444726+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-22T19:09:22.678 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:22 smithi062 bash[67442]: cluster 2024-02-22T19:09:21.492157+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v224: 129 pgs: 12 creating+peering, 4 unknown, 113 active+clean; 1.8 KiB data, 4.4 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-22T19:09:22.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:22 smithi063 bash[35391]: audit 2024-02-22T19:09:21.444665+0000 mon.a (mon.0) 548 : audit [INF] from='client.? 172.21.15.62:0/3172728709' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-02-22T19:09:22.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:22 smithi063 bash[35391]: cluster 2024-02-22T19:09:21.444726+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-22T19:09:22.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:22 smithi063 bash[35391]: cluster 2024-02-22T19:09:21.492157+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v224: 129 pgs: 12 creating+peering, 4 unknown, 113 active+clean; 1.8 KiB data, 4.4 MiB used, 707 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-22T19:09:24.199 INFO:teuthology.orchestra.run.smithi062.stdout:Scheduled rgw update... 2024-02-22T19:09:24.769 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[64101]: cluster 2024-02-22T19:09:23.492845+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v225: 129 pgs: 8 creating+peering, 121 active+clean; 3.1 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 810 B/s rd, 2.6 KiB/s wr, 10 op/s 2024-02-22T19:09:24.770 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[64101]: audit 2024-02-22T19:09:24.193293+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-02-22T19:09:24.192994\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2024-02-22T19:09:24.770 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[64101]: audit 2024-02-22T19:09:24.196865+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-02-22T19:09:24.192994\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2024-02-22T19:09:24.770 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[64101]: audit 2024-02-22T19:09:24.198993+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2024-02-22T19:09:24.770 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[64101]: audit 2024-02-22T19:09:24.203924+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2024-02-22T19:09:24.770 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[64101]: audit 2024-02-22T19:09:24.204678+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2024-02-22T19:09:24.770 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[64101]: audit 2024-02-22T19:09:24.208189+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2024-02-22T19:09:24.770 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[64101]: audit 2024-02-22T19:09:24.208962+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]: dispatch 2024-02-22T19:09:24.770 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[64101]: audit 2024-02-22T19:09:24.212280+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]': finished 2024-02-22T19:09:24.770 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[64101]: audit 2024-02-22T19:09:24.213067+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi063.feyald", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-02-22T19:09:24.770 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[64101]: audit 2024-02-22T19:09:24.215761+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi063.feyald", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-02-22T19:09:24.770 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[64101]: audit 2024-02-22T19:09:24.216350+0000 mon.a (mon.0) 560 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:09:24.770 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[64101]: audit 2024-02-22T19:09:24.217083+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi063.feyald", "key": "container_image"}]: dispatch 2024-02-22T19:09:24.770 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[67442]: cluster 2024-02-22T19:09:23.492845+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v225: 129 pgs: 8 creating+peering, 121 active+clean; 3.1 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 810 B/s rd, 2.6 KiB/s wr, 10 op/s 2024-02-22T19:09:24.771 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[67442]: audit 2024-02-22T19:09:24.193293+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-02-22T19:09:24.192994\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2024-02-22T19:09:24.771 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[67442]: audit 2024-02-22T19:09:24.196865+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-02-22T19:09:24.192994\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2024-02-22T19:09:24.771 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[67442]: audit 2024-02-22T19:09:24.198993+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2024-02-22T19:09:24.771 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[67442]: audit 2024-02-22T19:09:24.203924+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2024-02-22T19:09:24.771 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[67442]: audit 2024-02-22T19:09:24.204678+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2024-02-22T19:09:24.771 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[67442]: audit 2024-02-22T19:09:24.208189+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2024-02-22T19:09:24.771 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[67442]: audit 2024-02-22T19:09:24.208962+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]: dispatch 2024-02-22T19:09:24.771 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[67442]: audit 2024-02-22T19:09:24.212280+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]': finished 2024-02-22T19:09:24.771 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[67442]: audit 2024-02-22T19:09:24.213067+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi063.feyald", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-02-22T19:09:24.771 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[67442]: audit 2024-02-22T19:09:24.215761+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi063.feyald", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-02-22T19:09:24.771 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[67442]: audit 2024-02-22T19:09:24.216350+0000 mon.a (mon.0) 560 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:09:24.771 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:24 smithi062 bash[67442]: audit 2024-02-22T19:09:24.217083+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi063.feyald", "key": "container_image"}]: dispatch 2024-02-22T19:09:24.780 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'sleep 120' 2024-02-22T19:09:24.875 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:24 smithi063 bash[35391]: cluster 2024-02-22T19:09:23.492845+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v225: 129 pgs: 8 creating+peering, 121 active+clean; 3.1 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 810 B/s rd, 2.6 KiB/s wr, 10 op/s 2024-02-22T19:09:24.875 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:24 smithi063 bash[35391]: audit 2024-02-22T19:09:24.193293+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-02-22T19:09:24.192994\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2024-02-22T19:09:24.875 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:24 smithi063 bash[35391]: audit 2024-02-22T19:09:24.196865+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-02-22T19:09:24.192994\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2024-02-22T19:09:24.875 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:24 smithi063 bash[35391]: audit 2024-02-22T19:09:24.198993+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2024-02-22T19:09:24.875 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:24 smithi063 bash[35391]: audit 2024-02-22T19:09:24.203924+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2024-02-22T19:09:24.875 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:24 smithi063 bash[35391]: audit 2024-02-22T19:09:24.204678+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2024-02-22T19:09:24.876 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:24 smithi063 bash[35391]: audit 2024-02-22T19:09:24.208189+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2024-02-22T19:09:24.876 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:24 smithi063 bash[35391]: audit 2024-02-22T19:09:24.208962+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]: dispatch 2024-02-22T19:09:24.876 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:24 smithi063 bash[35391]: audit 2024-02-22T19:09:24.212280+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]': finished 2024-02-22T19:09:24.876 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:24 smithi063 bash[35391]: audit 2024-02-22T19:09:24.213067+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi063.feyald", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-02-22T19:09:24.876 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:24 smithi063 bash[35391]: audit 2024-02-22T19:09:24.215761+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi063.feyald", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-02-22T19:09:24.876 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:24 smithi063 bash[35391]: audit 2024-02-22T19:09:24.216350+0000 mon.a (mon.0) 560 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:09:24.876 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:24 smithi063 bash[35391]: audit 2024-02-22T19:09:24.217083+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi063.feyald", "key": "container_image"}]: dispatch 2024-02-22T19:09:25.904 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:25 smithi063 bash[35391]: audit 2024-02-22T19:09:24.192526+0000 mgr.y (mgr.14140) 229 : audit [DBG] from='client.14661 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:09:25.905 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:25 smithi063 bash[35391]: cephadm 2024-02-22T19:09:24.192982+0000 mgr.y (mgr.14140) 230 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2024-02-22T19:09:25.905 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:25 smithi063 bash[35391]: cephadm 2024-02-22T19:09:24.216833+0000 mgr.y (mgr.14140) 231 : cephadm [INF] Deploying daemon rgw.r.z.smithi063.feyald on smithi063 2024-02-22T19:09:25.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:25 smithi062 bash[64101]: audit 2024-02-22T19:09:24.192526+0000 mgr.y (mgr.14140) 229 : audit [DBG] from='client.14661 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:09:25.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:25 smithi062 bash[64101]: cephadm 2024-02-22T19:09:24.192982+0000 mgr.y (mgr.14140) 230 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2024-02-22T19:09:25.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:25 smithi062 bash[64101]: cephadm 2024-02-22T19:09:24.216833+0000 mgr.y (mgr.14140) 231 : cephadm [INF] Deploying daemon rgw.r.z.smithi063.feyald on smithi063 2024-02-22T19:09:25.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:25 smithi062 bash[67442]: audit 2024-02-22T19:09:24.192526+0000 mgr.y (mgr.14140) 229 : audit [DBG] from='client.14661 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:09:25.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:25 smithi062 bash[67442]: cephadm 2024-02-22T19:09:24.192982+0000 mgr.y (mgr.14140) 230 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2024-02-22T19:09:25.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:25 smithi062 bash[67442]: cephadm 2024-02-22T19:09:24.216833+0000 mgr.y (mgr.14140) 231 : cephadm [INF] Deploying daemon rgw.r.z.smithi063.feyald on smithi063 2024-02-22T19:09:26.768 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:26 smithi062 bash[64101]: cluster 2024-02-22T19:09:25.493206+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 3.2 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 507 B/s rd, 2.5 KiB/s wr, 9 op/s 2024-02-22T19:09:26.769 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:26 smithi062 bash[64101]: audit 2024-02-22T19:09:25.969092+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196385\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196461\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196495\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196525\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196555\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196584\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196614\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196655\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196686\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:09:26.769 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:26 smithi062 bash[64101]: audit 2024-02-22T19:09:25.972608+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196385\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196461\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196495\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196525\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196555\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196584\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196614\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196655\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196686\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:09:26.769 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:26 smithi062 bash[64101]: audit 2024-02-22T19:09:25.973299+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi062.zxmpna", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-02-22T19:09:26.769 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:26 smithi062 bash[64101]: audit 2024-02-22T19:09:25.979239+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi062.zxmpna", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-02-22T19:09:26.769 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:26 smithi062 bash[64101]: audit 2024-02-22T19:09:25.979964+0000 mon.a (mon.0) 566 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:09:26.769 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:26 smithi062 bash[64101]: audit 2024-02-22T19:09:25.980860+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi062.zxmpna", "key": "container_image"}]: dispatch 2024-02-22T19:09:26.770 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:26 smithi062 bash[67442]: cluster 2024-02-22T19:09:25.493206+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 3.2 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 507 B/s rd, 2.5 KiB/s wr, 9 op/s 2024-02-22T19:09:26.770 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:26 smithi062 bash[67442]: audit 2024-02-22T19:09:25.969092+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196385\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196461\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196495\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196525\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196555\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196584\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196614\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196655\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196686\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:09:26.770 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:26 smithi062 bash[67442]: audit 2024-02-22T19:09:25.972608+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196385\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196461\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196495\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196525\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196555\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196584\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196614\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196655\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196686\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:09:26.770 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:26 smithi062 bash[67442]: audit 2024-02-22T19:09:25.973299+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi062.zxmpna", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-02-22T19:09:26.770 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:26 smithi062 bash[67442]: audit 2024-02-22T19:09:25.979239+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi062.zxmpna", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-02-22T19:09:26.770 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:26 smithi062 bash[67442]: audit 2024-02-22T19:09:25.979964+0000 mon.a (mon.0) 566 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:09:26.770 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:26 smithi062 bash[67442]: audit 2024-02-22T19:09:25.980860+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi062.zxmpna", "key": "container_image"}]: dispatch 2024-02-22T19:09:26.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:26 smithi063 bash[35391]: cluster 2024-02-22T19:09:25.493206+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 3.2 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 507 B/s rd, 2.5 KiB/s wr, 9 op/s 2024-02-22T19:09:26.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:26 smithi063 bash[35391]: audit 2024-02-22T19:09:25.969092+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196385\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196461\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196495\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196525\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196555\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196584\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196614\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196655\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196686\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:09:26.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:26 smithi063 bash[35391]: audit 2024-02-22T19:09:25.972608+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196385\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196461\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196495\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196525\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196555\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196584\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196614\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196655\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:15.196686\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:09:26.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:26 smithi063 bash[35391]: audit 2024-02-22T19:09:25.973299+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi062.zxmpna", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-02-22T19:09:26.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:26 smithi063 bash[35391]: audit 2024-02-22T19:09:25.979239+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi062.zxmpna", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-02-22T19:09:26.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:26 smithi063 bash[35391]: audit 2024-02-22T19:09:25.979964+0000 mon.a (mon.0) 566 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:09:26.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:26 smithi063 bash[35391]: audit 2024-02-22T19:09:25.980860+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi062.zxmpna", "key": "container_image"}]: dispatch 2024-02-22T19:09:27.726 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:27 smithi062 bash[64101]: cephadm 2024-02-22T19:09:25.980489+0000 mgr.y (mgr.14140) 233 : cephadm [INF] Deploying daemon rgw.r.z.smithi062.zxmpna on smithi062 2024-02-22T19:09:27.726 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:27 smithi062 bash[67442]: cephadm 2024-02-22T19:09:25.980489+0000 mgr.y (mgr.14140) 233 : cephadm [INF] Deploying daemon rgw.r.z.smithi062.zxmpna on smithi062 2024-02-22T19:09:27.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:27 smithi063 bash[35391]: cephadm 2024-02-22T19:09:25.980489+0000 mgr.y (mgr.14140) 233 : cephadm [INF] Deploying daemon rgw.r.z.smithi062.zxmpna on smithi062 2024-02-22T19:09:28.572 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:28 smithi062 bash[64101]: cluster 2024-02-22T19:09:27.493692+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 6.9 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 895 B/s rd, 4.9 KiB/s wr, 18 op/s 2024-02-22T19:09:28.572 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:28 smithi062 bash[64101]: audit 2024-02-22T19:09:27.791297+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876185\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876259\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876293\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876325\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876354\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876384\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876414\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876444\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876474\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}, \"rgw.r.z.smithi062.zxmpna\": {\"hostname\": \"smithi062\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:09:28.572 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:28 smithi062 bash[67442]: cluster 2024-02-22T19:09:27.493692+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 6.9 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 895 B/s rd, 4.9 KiB/s wr, 18 op/s 2024-02-22T19:09:28.572 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:28 smithi062 bash[67442]: audit 2024-02-22T19:09:27.791297+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876185\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876259\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876293\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876325\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876354\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876384\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876414\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876444\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876474\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}, \"rgw.r.z.smithi062.zxmpna\": {\"hostname\": \"smithi062\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:09:28.572 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:28 smithi062 bash[64101]: audit 2024-02-22T19:09:27.794158+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876185\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876259\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876293\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876325\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876354\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876384\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876414\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876444\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876474\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}, \"rgw.r.z.smithi062.zxmpna\": {\"hostname\": \"smithi062\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:09:28.573 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:28 smithi062 bash[64101]: audit 2024-02-22T19:09:27.794965+0000 mon.a (mon.0) 570 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:09:28.573 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:28 smithi062 bash[67442]: audit 2024-02-22T19:09:27.794158+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876185\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876259\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876293\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876325\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876354\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876384\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876414\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876444\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876474\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}, \"rgw.r.z.smithi062.zxmpna\": {\"hostname\": \"smithi062\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:09:28.573 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:28 smithi062 bash[67442]: audit 2024-02-22T19:09:27.794965+0000 mon.a (mon.0) 570 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:09:28.865 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:28 smithi063 bash[35391]: cluster 2024-02-22T19:09:27.493692+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 6.9 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 895 B/s rd, 4.9 KiB/s wr, 18 op/s 2024-02-22T19:09:28.865 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:28 smithi063 bash[35391]: audit 2024-02-22T19:09:27.791297+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876185\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876259\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876293\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876325\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876354\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876384\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876414\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876444\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876474\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}, \"rgw.r.z.smithi062.zxmpna\": {\"hostname\": \"smithi062\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:09:28.865 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:28 smithi063 bash[35391]: audit 2024-02-22T19:09:27.794158+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876185\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876259\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876293\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876325\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876354\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876384\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876414\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876444\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:11.876474\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}, \"rgw.r.z.smithi062.zxmpna\": {\"hostname\": \"smithi062\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:09:28.865 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:28 smithi063 bash[35391]: audit 2024-02-22T19:09:27.794965+0000 mon.a (mon.0) 570 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:09:30.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:30 smithi062 bash[64101]: cluster 2024-02-22T19:09:29.494250+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 6.9 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 25 KiB/s rd, 4.3 KiB/s wr, 64 op/s 2024-02-22T19:09:30.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:30 smithi062 bash[67442]: cluster 2024-02-22T19:09:29.494250+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 6.9 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 25 KiB/s rd, 4.3 KiB/s wr, 64 op/s 2024-02-22T19:09:30.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:30 smithi063 bash[35391]: cluster 2024-02-22T19:09:29.494250+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 6.9 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 25 KiB/s rd, 4.3 KiB/s wr, 64 op/s 2024-02-22T19:09:31.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:31 smithi063 bash[35391]: audit 2024-02-22T19:09:30.747037+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.745894\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.745968\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746003\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746034\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746063\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746092\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746121\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746151\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746180\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}, \"rgw.r.z.smithi062.zxmpna\": {\"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746209\", \"created\": \"2024-02-22T19:09:27.756525\", \"started\": \"2024-02-22T19:09:27.790468\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733\"}}, \"last_daemon_update\": \"2024-02-22T19:09:30.746282\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:09:31.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:31 smithi063 bash[35391]: audit 2024-02-22T19:09:30.750004+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.745894\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.745968\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746003\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746034\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746063\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746092\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746121\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746151\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746180\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}, \"rgw.r.z.smithi062.zxmpna\": {\"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746209\", \"created\": \"2024-02-22T19:09:27.756525\", \"started\": \"2024-02-22T19:09:27.790468\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733\"}}, \"last_daemon_update\": \"2024-02-22T19:09:30.746282\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:09:31.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:31 smithi063 bash[35391]: audit 2024-02-22T19:09:30.750568+0000 mon.a (mon.0) 573 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:09:31.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:31 smithi062 bash[64101]: audit 2024-02-22T19:09:30.747037+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.745894\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.745968\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746003\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746034\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746063\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746092\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746121\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746151\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746180\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}, \"rgw.r.z.smithi062.zxmpna\": {\"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746209\", \"created\": \"2024-02-22T19:09:27.756525\", \"started\": \"2024-02-22T19:09:27.790468\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733\"}}, \"last_daemon_update\": \"2024-02-22T19:09:30.746282\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:09:31.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:31 smithi062 bash[67442]: audit 2024-02-22T19:09:30.747037+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.745894\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.745968\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746003\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746034\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746063\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746092\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746121\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746151\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746180\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}, \"rgw.r.z.smithi062.zxmpna\": {\"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746209\", \"created\": \"2024-02-22T19:09:27.756525\", \"started\": \"2024-02-22T19:09:27.790468\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733\"}}, \"last_daemon_update\": \"2024-02-22T19:09:30.746282\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]: dispatch 2024-02-22T19:09:31.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:31 smithi062 bash[64101]: audit 2024-02-22T19:09:30.750004+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.745894\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.745968\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746003\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746034\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746063\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746092\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746121\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746151\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746180\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}, \"rgw.r.z.smithi062.zxmpna\": {\"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746209\", \"created\": \"2024-02-22T19:09:27.756525\", \"started\": \"2024-02-22T19:09:27.790468\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733\"}}, \"last_daemon_update\": \"2024-02-22T19:09:30.746282\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:09:31.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:31 smithi062 bash[64101]: audit 2024-02-22T19:09:30.750568+0000 mon.a (mon.0) 573 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:09:31.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:31 smithi062 bash[67442]: audit 2024-02-22T19:09:30.750004+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.745894\", \"created\": \"2024-02-22T19:02:43.425956\", \"started\": \"2024-02-22T19:02:48.798298\"}, \"mgr.y\": {\"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.745968\", \"created\": \"2024-02-22T19:02:50.704838\", \"started\": \"2024-02-22T19:02:50.738589\"}, \"mon.c\": {\"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746003\", \"created\": \"2024-02-22T19:04:13.478486\", \"started\": \"2024-02-22T19:04:13.513746\"}, \"osd.0\": {\"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746034\", \"created\": \"2024-02-22T19:05:07.425639\", \"started\": \"2024-02-22T19:05:10.108570\"}, \"osd.1\": {\"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746063\", \"created\": \"2024-02-22T19:05:27.833320\", \"started\": \"2024-02-22T19:05:29.464787\"}, \"osd.2\": {\"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746092\", \"created\": \"2024-02-22T19:05:46.128031\", \"started\": \"2024-02-22T19:05:48.339230\"}, \"osd.3\": {\"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746121\", \"created\": \"2024-02-22T19:06:04.783735\", \"started\": \"2024-02-22T19:06:07.096445\"}, \"node-exporter.a\": {\"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746151\", \"created\": \"2024-02-22T19:07:53.457021\", \"started\": \"2024-02-22T19:08:03.594719\"}, \"alertmanager.a\": {\"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746180\", \"created\": \"2024-02-22T19:08:09.303770\", \"started\": \"2024-02-22T19:08:46.427160\"}, \"rgw.r.z.smithi062.zxmpna\": {\"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:30.746209\", \"created\": \"2024-02-22T19:09:27.756525\", \"started\": \"2024-02-22T19:09:27.790468\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733\"}}, \"last_daemon_update\": \"2024-02-22T19:09:30.746282\", \"last_device_update\": \"2024-02-22T19:06:10.932080\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.62\"]}, \"last_host_check\": \"2024-02-22T19:03:18.769851\"}"}]': finished 2024-02-22T19:09:31.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:31 smithi062 bash[67442]: audit 2024-02-22T19:09:30.750568+0000 mon.a (mon.0) 573 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:09:32.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:32 smithi063 bash[35391]: cluster 2024-02-22T19:09:31.494972+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 91 KiB/s rd, 4.1 KiB/s wr, 181 op/s 2024-02-22T19:09:32.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:32 smithi062 bash[64101]: cluster 2024-02-22T19:09:31.494972+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 91 KiB/s rd, 4.1 KiB/s wr, 181 op/s 2024-02-22T19:09:32.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:32 smithi062 bash[67442]: cluster 2024-02-22T19:09:31.494972+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 91 KiB/s rd, 4.1 KiB/s wr, 181 op/s 2024-02-22T19:09:34.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:34 smithi063 bash[35391]: cluster 2024-02-22T19:09:33.495489+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 94 KiB/s rd, 3.4 KiB/s wr, 178 op/s 2024-02-22T19:09:34.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:34 smithi063 bash[35391]: audit 2024-02-22T19:09:34.251880+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250513\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250608\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250664\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250704\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250738\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250770\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250802\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250835\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250867\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250900\", \"created\": \"2024-02-22T19:09:25.934973\", \"started\": \"2024-02-22T19:09:25.968393\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_daemon_update\": \"2024-02-22T19:09:34.250996\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:09:34.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:34 smithi063 bash[35391]: audit 2024-02-22T19:09:34.255313+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250513\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250608\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250664\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250704\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250738\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250770\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250802\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250835\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250867\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250900\", \"created\": \"2024-02-22T19:09:25.934973\", \"started\": \"2024-02-22T19:09:25.968393\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_daemon_update\": \"2024-02-22T19:09:34.250996\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:09:34.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:34 smithi062 bash[64101]: cluster 2024-02-22T19:09:33.495489+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 94 KiB/s rd, 3.4 KiB/s wr, 178 op/s 2024-02-22T19:09:34.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:34 smithi062 bash[67442]: cluster 2024-02-22T19:09:33.495489+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 94 KiB/s rd, 3.4 KiB/s wr, 178 op/s 2024-02-22T19:09:34.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:34 smithi062 bash[64101]: audit 2024-02-22T19:09:34.251880+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250513\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250608\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250664\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250704\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250738\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250770\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250802\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250835\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250867\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250900\", \"created\": \"2024-02-22T19:09:25.934973\", \"started\": \"2024-02-22T19:09:25.968393\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_daemon_update\": \"2024-02-22T19:09:34.250996\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:09:34.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:34 smithi062 bash[64101]: audit 2024-02-22T19:09:34.255313+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250513\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250608\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250664\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250704\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250738\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250770\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250802\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250835\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250867\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250900\", \"created\": \"2024-02-22T19:09:25.934973\", \"started\": \"2024-02-22T19:09:25.968393\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_daemon_update\": \"2024-02-22T19:09:34.250996\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:09:34.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:34 smithi062 bash[67442]: audit 2024-02-22T19:09:34.251880+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250513\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250608\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250664\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250704\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250738\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250770\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250802\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250835\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250867\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250900\", \"created\": \"2024-02-22T19:09:25.934973\", \"started\": \"2024-02-22T19:09:25.968393\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_daemon_update\": \"2024-02-22T19:09:34.250996\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:09:34.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:34 smithi062 bash[67442]: audit 2024-02-22T19:09:34.255313+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250513\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"ab327e92079c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250608\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:04:48.683083\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250664\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250704\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250738\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250770\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250802\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250835\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250867\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250900\", \"created\": \"2024-02-22T19:09:25.934973\", \"started\": \"2024-02-22T19:09:25.968393\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:46.638174\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_daemon_update\": \"2024-02-22T19:09:34.250996\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:09:36.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:36 smithi063 bash[35391]: cluster 2024-02-22T19:09:35.495941+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 2.3 KiB/s wr, 174 op/s 2024-02-22T19:09:36.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:36 smithi062 bash[64101]: cluster 2024-02-22T19:09:35.495941+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 2.3 KiB/s wr, 174 op/s 2024-02-22T19:09:36.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:36 smithi062 bash[67442]: cluster 2024-02-22T19:09:35.495941+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 2.3 KiB/s wr, 174 op/s 2024-02-22T19:09:38.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:38 smithi063 bash[35391]: cluster 2024-02-22T19:09:37.496591+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 2.2 KiB/s wr, 173 op/s 2024-02-22T19:09:38.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:38 smithi062 bash[64101]: cluster 2024-02-22T19:09:37.496591+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 2.2 KiB/s wr, 173 op/s 2024-02-22T19:09:38.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:38 smithi062 bash[67442]: cluster 2024-02-22T19:09:37.496591+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 2.2 KiB/s wr, 173 op/s 2024-02-22T19:09:40.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:40 smithi063 bash[35391]: cluster 2024-02-22T19:09:39.497309+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 170 B/s wr, 166 op/s 2024-02-22T19:09:40.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:40 smithi062 bash[64101]: cluster 2024-02-22T19:09:39.497309+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 170 B/s wr, 166 op/s 2024-02-22T19:09:40.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:40 smithi062 bash[67442]: cluster 2024-02-22T19:09:39.497309+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 170 B/s wr, 166 op/s 2024-02-22T19:09:41.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:41 smithi063 bash[35391]: cluster 2024-02-22T19:09:41.497954+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 75 KiB/s rd, 170 B/s wr, 130 op/s 2024-02-22T19:09:41.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:41 smithi062 bash[64101]: cluster 2024-02-22T19:09:41.497954+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 75 KiB/s rd, 170 B/s wr, 130 op/s 2024-02-22T19:09:41.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:41 smithi062 bash[67442]: cluster 2024-02-22T19:09:41.497954+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 75 KiB/s rd, 170 B/s wr, 130 op/s 2024-02-22T19:09:44.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:44 smithi063 bash[35391]: cluster 2024-02-22T19:09:43.498500+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 26 op/s 2024-02-22T19:09:44.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:44 smithi062 bash[64101]: cluster 2024-02-22T19:09:43.498500+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 26 op/s 2024-02-22T19:09:44.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:44 smithi062 bash[67442]: cluster 2024-02-22T19:09:43.498500+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 17 KiB/s rd, 0 B/s wr, 26 op/s 2024-02-22T19:09:46.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:46 smithi063 bash[35391]: cluster 2024-02-22T19:09:45.499087+0000 mgr.y (mgr.14140) 243 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:46.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:46 smithi062 bash[64101]: cluster 2024-02-22T19:09:45.499087+0000 mgr.y (mgr.14140) 243 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:46.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:46 smithi062 bash[67442]: cluster 2024-02-22T19:09:45.499087+0000 mgr.y (mgr.14140) 243 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:48.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:48 smithi063 bash[35391]: cluster 2024-02-22T19:09:47.499611+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:48.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:48 smithi062 bash[64101]: cluster 2024-02-22T19:09:47.499611+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:48.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:48 smithi062 bash[67442]: cluster 2024-02-22T19:09:47.499611+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:50.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:50 smithi063 bash[35391]: cluster 2024-02-22T19:09:49.500396+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:50.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:50 smithi062 bash[64101]: cluster 2024-02-22T19:09:49.500396+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:50.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:50 smithi062 bash[67442]: cluster 2024-02-22T19:09:49.500396+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:52.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:52 smithi063 bash[35391]: cluster 2024-02-22T19:09:51.500915+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:52.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:52 smithi062 bash[64101]: cluster 2024-02-22T19:09:51.500915+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:52.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:52 smithi062 bash[67442]: cluster 2024-02-22T19:09:51.500915+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:54.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:54 smithi063 bash[35391]: cluster 2024-02-22T19:09:53.501586+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:54.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:54 smithi062 bash[64101]: cluster 2024-02-22T19:09:53.501586+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:54.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:54 smithi062 bash[67442]: cluster 2024-02-22T19:09:53.501586+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:56.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:56 smithi063 bash[35391]: cluster 2024-02-22T19:09:55.502220+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:56.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:56 smithi062 bash[64101]: cluster 2024-02-22T19:09:55.502220+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:56.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:56 smithi062 bash[67442]: cluster 2024-02-22T19:09:55.502220+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:58.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:09:58 smithi063 bash[35391]: cluster 2024-02-22T19:09:57.502787+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:58.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:09:58 smithi062 bash[64101]: cluster 2024-02-22T19:09:57.502787+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:09:58.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:09:58 smithi062 bash[67442]: cluster 2024-02-22T19:09:57.502787+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:00.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:00 smithi063 bash[35391]: cluster 2024-02-22T19:09:59.503318+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:00.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:00 smithi062 bash[64101]: cluster 2024-02-22T19:09:59.503318+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:00.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:00 smithi062 bash[67442]: cluster 2024-02-22T19:09:59.503318+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:01.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:01 smithi063 bash[35391]: cluster 2024-02-22T19:10:01.503886+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:01.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:01 smithi062 bash[64101]: cluster 2024-02-22T19:10:01.503886+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:01.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:01 smithi062 bash[67442]: cluster 2024-02-22T19:10:01.503886+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:04.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:04 smithi063 bash[35391]: cluster 2024-02-22T19:10:03.504425+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:04.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:04 smithi062 bash[64101]: cluster 2024-02-22T19:10:03.504425+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:04.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:04 smithi062 bash[67442]: cluster 2024-02-22T19:10:03.504425+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:06.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:06 smithi063 bash[35391]: cluster 2024-02-22T19:10:05.504951+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:06.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:06 smithi062 bash[64101]: cluster 2024-02-22T19:10:05.504951+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:06.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:06 smithi062 bash[67442]: cluster 2024-02-22T19:10:05.504951+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:08.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:08 smithi063 bash[35391]: cluster 2024-02-22T19:10:07.505559+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:08.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:08 smithi062 bash[64101]: cluster 2024-02-22T19:10:07.505559+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:08.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:08 smithi062 bash[67442]: cluster 2024-02-22T19:10:07.505559+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:10.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:10 smithi063 bash[35391]: cluster 2024-02-22T19:10:09.506146+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:10.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:10 smithi062 bash[64101]: cluster 2024-02-22T19:10:09.506146+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:10.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:10 smithi062 bash[67442]: cluster 2024-02-22T19:10:09.506146+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:12.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:12 smithi063 bash[35391]: cluster 2024-02-22T19:10:11.506895+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:12.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:12 smithi062 bash[64101]: cluster 2024-02-22T19:10:11.506895+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:12.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:12 smithi062 bash[67442]: cluster 2024-02-22T19:10:11.506895+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:14.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:14 smithi063 bash[35391]: cluster 2024-02-22T19:10:13.507569+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:14.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:14 smithi062 bash[64101]: cluster 2024-02-22T19:10:13.507569+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:14.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:14 smithi062 bash[67442]: cluster 2024-02-22T19:10:13.507569+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:16.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:16 smithi063 bash[35391]: cluster 2024-02-22T19:10:15.508100+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:16.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:16 smithi062 bash[64101]: cluster 2024-02-22T19:10:15.508100+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:16.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:16 smithi062 bash[67442]: cluster 2024-02-22T19:10:15.508100+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:17.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:17 smithi063 bash[35391]: cluster 2024-02-22T19:10:17.508810+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:17.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:17 smithi062 bash[64101]: cluster 2024-02-22T19:10:17.508810+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:17.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:17 smithi062 bash[67442]: cluster 2024-02-22T19:10:17.508810+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:20.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:20 smithi063 bash[35391]: cluster 2024-02-22T19:10:19.509422+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:20.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:20 smithi062 bash[64101]: cluster 2024-02-22T19:10:19.509422+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:20.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:20 smithi062 bash[67442]: cluster 2024-02-22T19:10:19.509422+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:22.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:22 smithi063 bash[35391]: cluster 2024-02-22T19:10:21.510241+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:22.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:22 smithi062 bash[64101]: cluster 2024-02-22T19:10:21.510241+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:22.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:22 smithi062 bash[67442]: cluster 2024-02-22T19:10:21.510241+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:24.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:24 smithi063 bash[35391]: cluster 2024-02-22T19:10:23.510870+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:24.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:24 smithi062 bash[64101]: cluster 2024-02-22T19:10:23.510870+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:24.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:24 smithi062 bash[67442]: cluster 2024-02-22T19:10:23.510870+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:26.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:26 smithi063 bash[35391]: cluster 2024-02-22T19:10:25.511274+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:26.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:26 smithi062 bash[64101]: cluster 2024-02-22T19:10:25.511274+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:26.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:26 smithi062 bash[67442]: cluster 2024-02-22T19:10:25.511274+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:28.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:28 smithi063 bash[35391]: cluster 2024-02-22T19:10:27.511912+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:28.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:28 smithi062 bash[64101]: cluster 2024-02-22T19:10:27.511912+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:28.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:28 smithi062 bash[67442]: cluster 2024-02-22T19:10:27.511912+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:30.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:30 smithi063 bash[35391]: cluster 2024-02-22T19:10:29.512619+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:30.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:30 smithi062 bash[64101]: cluster 2024-02-22T19:10:29.512619+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:30.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:30 smithi062 bash[67442]: cluster 2024-02-22T19:10:29.512619+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:32.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:32 smithi063 bash[35391]: cluster 2024-02-22T19:10:31.513180+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:32.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:32 smithi062 bash[64101]: cluster 2024-02-22T19:10:31.513180+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:32.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:32 smithi062 bash[67442]: cluster 2024-02-22T19:10:31.513180+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:34.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:34 smithi063 bash[35391]: cluster 2024-02-22T19:10:33.513821+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:34.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:34 smithi062 bash[64101]: cluster 2024-02-22T19:10:33.513821+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:34.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:34 smithi062 bash[67442]: cluster 2024-02-22T19:10:33.513821+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:36.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:36 smithi063 bash[35391]: cluster 2024-02-22T19:10:35.514289+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:36.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:36 smithi062 bash[64101]: cluster 2024-02-22T19:10:35.514289+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:36.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:36 smithi062 bash[67442]: cluster 2024-02-22T19:10:35.514289+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:38.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:38 smithi063 bash[35391]: cluster 2024-02-22T19:10:37.515011+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:38.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:38 smithi062 bash[64101]: cluster 2024-02-22T19:10:37.515011+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:38.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:38 smithi062 bash[67442]: cluster 2024-02-22T19:10:37.515011+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:40.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:40 smithi063 bash[35391]: cluster 2024-02-22T19:10:39.515556+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:40.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:40 smithi062 bash[64101]: cluster 2024-02-22T19:10:39.515556+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:40.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:40 smithi062 bash[67442]: cluster 2024-02-22T19:10:39.515556+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:42.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:42 smithi063 bash[35391]: cluster 2024-02-22T19:10:41.516138+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:42.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:42 smithi062 bash[64101]: cluster 2024-02-22T19:10:41.516138+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:42.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:42 smithi062 bash[67442]: cluster 2024-02-22T19:10:41.516138+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:44.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:44 smithi063 bash[35391]: cluster 2024-02-22T19:10:43.516785+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:44.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:44 smithi062 bash[64101]: cluster 2024-02-22T19:10:43.516785+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:44.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:44 smithi062 bash[67442]: cluster 2024-02-22T19:10:43.516785+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:46.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:46 smithi063 bash[35391]: cluster 2024-02-22T19:10:45.517291+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:46.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:46 smithi062 bash[64101]: cluster 2024-02-22T19:10:45.517291+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:46.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:46 smithi062 bash[67442]: cluster 2024-02-22T19:10:45.517291+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:48.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:48 smithi063 bash[35391]: cluster 2024-02-22T19:10:47.518105+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:48.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:48 smithi062 bash[64101]: cluster 2024-02-22T19:10:47.518105+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:48.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:48 smithi062 bash[67442]: cluster 2024-02-22T19:10:47.518105+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:50.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:50 smithi063 bash[35391]: cluster 2024-02-22T19:10:49.518678+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:50.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:50 smithi062 bash[64101]: cluster 2024-02-22T19:10:49.518678+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:50.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:50 smithi062 bash[67442]: cluster 2024-02-22T19:10:49.518678+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:52.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:52 smithi063 bash[35391]: cluster 2024-02-22T19:10:51.519421+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:52.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:52 smithi062 bash[64101]: cluster 2024-02-22T19:10:51.519421+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:52.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:52 smithi062 bash[67442]: cluster 2024-02-22T19:10:51.519421+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:54.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:54 smithi063 bash[35391]: cluster 2024-02-22T19:10:53.519973+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:54.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:54 smithi062 bash[64101]: cluster 2024-02-22T19:10:53.519973+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:54.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:54 smithi062 bash[67442]: cluster 2024-02-22T19:10:53.519973+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:56.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:56 smithi063 bash[35391]: cluster 2024-02-22T19:10:55.520553+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:56.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:56 smithi062 bash[64101]: cluster 2024-02-22T19:10:55.520553+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:56.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:56 smithi062 bash[67442]: cluster 2024-02-22T19:10:55.520553+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:58.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:10:58 smithi063 bash[35391]: cluster 2024-02-22T19:10:57.521253+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:58.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:10:58 smithi062 bash[64101]: cluster 2024-02-22T19:10:57.521253+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:10:58.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:10:58 smithi062 bash[67442]: cluster 2024-02-22T19:10:57.521253+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:00.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:00 smithi063 bash[35391]: cluster 2024-02-22T19:10:59.521876+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:00.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:00 smithi062 bash[64101]: cluster 2024-02-22T19:10:59.521876+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:00.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:00 smithi062 bash[67442]: cluster 2024-02-22T19:10:59.521876+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:02.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:02 smithi063 bash[35391]: cluster 2024-02-22T19:11:01.522447+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:02.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:02 smithi062 bash[64101]: cluster 2024-02-22T19:11:01.522447+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:02.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:02 smithi062 bash[67442]: cluster 2024-02-22T19:11:01.522447+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:04.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:04 smithi063 bash[35391]: cluster 2024-02-22T19:11:03.522921+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:04.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:04 smithi062 bash[64101]: cluster 2024-02-22T19:11:03.522921+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:04.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:04 smithi062 bash[67442]: cluster 2024-02-22T19:11:03.522921+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:06.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:06 smithi063 bash[35391]: cluster 2024-02-22T19:11:05.523557+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:06.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:06 smithi062 bash[64101]: cluster 2024-02-22T19:11:05.523557+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:06.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:06 smithi062 bash[67442]: cluster 2024-02-22T19:11:05.523557+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:08.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:08 smithi063 bash[35391]: cluster 2024-02-22T19:11:07.524331+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:08.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:08 smithi062 bash[64101]: cluster 2024-02-22T19:11:07.524331+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:08.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:08 smithi062 bash[67442]: cluster 2024-02-22T19:11:07.524331+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:10.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:10 smithi063 bash[35391]: cluster 2024-02-22T19:11:09.524918+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:10.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:10 smithi062 bash[64101]: cluster 2024-02-22T19:11:09.524918+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:10.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:10 smithi062 bash[67442]: cluster 2024-02-22T19:11:09.524918+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:12.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:12 smithi063 bash[35391]: cluster 2024-02-22T19:11:11.525556+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:12.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:12 smithi062 bash[64101]: cluster 2024-02-22T19:11:11.525556+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:12.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:12 smithi062 bash[67442]: cluster 2024-02-22T19:11:11.525556+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:13.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:13 smithi063 bash[35391]: cluster 2024-02-22T19:11:13.525990+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:13.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:13 smithi062 bash[64101]: cluster 2024-02-22T19:11:13.525990+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:13.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:13 smithi062 bash[67442]: cluster 2024-02-22T19:11:13.525990+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:16.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:16 smithi063 bash[35391]: cluster 2024-02-22T19:11:15.526679+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:16.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:16 smithi062 bash[64101]: cluster 2024-02-22T19:11:15.526679+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:16.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:16 smithi062 bash[67442]: cluster 2024-02-22T19:11:15.526679+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:18.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:18 smithi063 bash[35391]: cluster 2024-02-22T19:11:17.527388+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:18.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:18 smithi062 bash[64101]: cluster 2024-02-22T19:11:17.527388+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:18.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:18 smithi062 bash[67442]: cluster 2024-02-22T19:11:17.527388+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:20.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:20 smithi063 bash[35391]: cluster 2024-02-22T19:11:19.528111+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:20.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:20 smithi062 bash[64101]: cluster 2024-02-22T19:11:19.528111+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:20.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:20 smithi062 bash[67442]: cluster 2024-02-22T19:11:19.528111+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:22.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:22 smithi063 bash[35391]: cluster 2024-02-22T19:11:21.528611+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:22.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:22 smithi062 bash[64101]: cluster 2024-02-22T19:11:21.528611+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:22.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:22 smithi062 bash[67442]: cluster 2024-02-22T19:11:21.528611+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:24.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:24 smithi063 bash[35391]: cluster 2024-02-22T19:11:23.529120+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:24.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:24 smithi062 bash[64101]: cluster 2024-02-22T19:11:23.529120+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:24.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:24 smithi062 bash[67442]: cluster 2024-02-22T19:11:23.529120+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:26.959 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:26 smithi062 bash[64101]: cluster 2024-02-22T19:11:25.529707+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:26.959 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:26 smithi062 bash[67442]: cluster 2024-02-22T19:11:25.529707+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:26.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:26 smithi063 bash[35391]: cluster 2024-02-22T19:11:25.529707+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:27.465 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-22T19:11:27.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:27 smithi062 bash[64101]: cluster 2024-02-22T19:11:27.530232+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:27.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:27 smithi062 bash[67442]: cluster 2024-02-22T19:11:27.530232+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:27.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:27 smithi063 bash[35391]: cluster 2024-02-22T19:11:27.530232+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:29.696 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:29 smithi062 bash[64101]: audit 2024-02-22T19:11:29.402089+0000 mon.a (mon.0) 576 : audit [INF] from='client.? 172.21.15.62:0/23349430' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2024-02-22T19:11:29.696 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:29 smithi062 bash[64101]: audit 2024-02-22T19:11:29.405731+0000 mon.a (mon.0) 577 : audit [INF] from='client.? 172.21.15.62:0/23349430' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]': finished 2024-02-22T19:11:29.696 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:29 smithi062 bash[67442]: audit 2024-02-22T19:11:29.402089+0000 mon.a (mon.0) 576 : audit [INF] from='client.? 172.21.15.62:0/23349430' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2024-02-22T19:11:29.697 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:29 smithi062 bash[67442]: audit 2024-02-22T19:11:29.405731+0000 mon.a (mon.0) 577 : audit [INF] from='client.? 172.21.15.62:0/23349430' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]': finished 2024-02-22T19:11:29.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:29 smithi063 bash[35391]: audit 2024-02-22T19:11:29.402089+0000 mon.a (mon.0) 576 : audit [INF] from='client.? 172.21.15.62:0/23349430' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2024-02-22T19:11:29.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:29 smithi063 bash[35391]: audit 2024-02-22T19:11:29.405731+0000 mon.a (mon.0) 577 : audit [INF] from='client.? 172.21.15.62:0/23349430' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]': finished 2024-02-22T19:11:30.005 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-22T19:11:30.655 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:30 smithi062 bash[64101]: cluster 2024-02-22T19:11:29.530770+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:30.656 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:30 smithi062 bash[67442]: cluster 2024-02-22T19:11:29.530770+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:30.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:30 smithi063 bash[35391]: cluster 2024-02-22T19:11:29.530770+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:32.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:32 smithi062 bash[64101]: cluster 2024-02-22T19:11:31.531514+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:32.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:32 smithi062 bash[64101]: audit 2024-02-22T19:11:31.943979+0000 mon.c (mon.1) 17 : audit [INF] from='client.? 172.21.15.62:0/3515510389' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2024-02-22T19:11:32.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:32 smithi062 bash[64101]: audit 2024-02-22T19:11:31.944249+0000 mon.a (mon.0) 578 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2024-02-22T19:11:32.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:32 smithi062 bash[64101]: audit 2024-02-22T19:11:31.948200+0000 mon.a (mon.0) 579 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]': finished 2024-02-22T19:11:32.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:32 smithi062 bash[67442]: cluster 2024-02-22T19:11:31.531514+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:32.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:32 smithi062 bash[67442]: audit 2024-02-22T19:11:31.943979+0000 mon.c (mon.1) 17 : audit [INF] from='client.? 172.21.15.62:0/3515510389' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2024-02-22T19:11:32.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:32 smithi062 bash[67442]: audit 2024-02-22T19:11:31.944249+0000 mon.a (mon.0) 578 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2024-02-22T19:11:32.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:32 smithi062 bash[67442]: audit 2024-02-22T19:11:31.948200+0000 mon.a (mon.0) 579 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]': finished 2024-02-22T19:11:32.753 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-22T19:11:32.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:32 smithi063 bash[35391]: cluster 2024-02-22T19:11:31.531514+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:32.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:32 smithi063 bash[35391]: audit 2024-02-22T19:11:31.943979+0000 mon.c (mon.1) 17 : audit [INF] from='client.? 172.21.15.62:0/3515510389' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2024-02-22T19:11:32.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:32 smithi063 bash[35391]: audit 2024-02-22T19:11:31.944249+0000 mon.a (mon.0) 578 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2024-02-22T19:11:32.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:32 smithi063 bash[35391]: audit 2024-02-22T19:11:31.948200+0000 mon.a (mon.0) 579 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]': finished 2024-02-22T19:11:34.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:34 smithi062 bash[64101]: cluster 2024-02-22T19:11:33.531940+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:34.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:34 smithi062 bash[67442]: cluster 2024-02-22T19:11:33.531940+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:34.956 INFO:teuthology.orchestra.run.smithi062.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 2024-02-22T19:11:34.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:34 smithi063 bash[35391]: cluster 2024-02-22T19:11:33.531940+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:35.518 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-22T19:11:35.529 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi062.front.sepia.ceph.com 2024-02-22T19:11:35.530 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-02-22T19:11:35.915 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:35 smithi062 bash[64101]: audit 2024-02-22T19:11:34.951305+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\"}"}]: dispatch 2024-02-22T19:11:35.915 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:35 smithi062 bash[64101]: audit 2024-02-22T19:11:34.954056+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\"}"}]': finished 2024-02-22T19:11:35.915 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:35 smithi062 bash[67442]: audit 2024-02-22T19:11:34.951305+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\"}"}]: dispatch 2024-02-22T19:11:35.916 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:35 smithi062 bash[67442]: audit 2024-02-22T19:11:34.954056+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\"}"}]': finished 2024-02-22T19:11:35.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:35 smithi063 bash[35391]: audit 2024-02-22T19:11:34.951305+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\"}"}]: dispatch 2024-02-22T19:11:35.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:35 smithi063 bash[35391]: audit 2024-02-22T19:11:34.954056+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\"}"}]': finished 2024-02-22T19:11:36.816 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:36 smithi062 bash[64101]: audit 2024-02-22T19:11:34.950389+0000 mgr.y (mgr.14140) 298 : audit [DBG] from='client.14721 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:11:36.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:36 smithi062 bash[64101]: cephadm 2024-02-22T19:11:34.956145+0000 mgr.y (mgr.14140) 299 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 2024-02-22T19:11:36.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:36 smithi062 bash[64101]: cluster 2024-02-22T19:11:35.532375+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:36.817 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:36 smithi062 bash[67442]: audit 2024-02-22T19:11:34.950389+0000 mgr.y (mgr.14140) 298 : audit [DBG] from='client.14721 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:11:36.817 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:36 smithi062 bash[67442]: cephadm 2024-02-22T19:11:34.956145+0000 mgr.y (mgr.14140) 299 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 2024-02-22T19:11:36.817 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:36 smithi062 bash[67442]: cluster 2024-02-22T19:11:35.532375+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:36.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:36 smithi063 bash[35391]: audit 2024-02-22T19:11:34.950389+0000 mgr.y (mgr.14140) 298 : audit [DBG] from='client.14721 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:11:36.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:36 smithi063 bash[35391]: cephadm 2024-02-22T19:11:34.956145+0000 mgr.y (mgr.14140) 299 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 2024-02-22T19:11:36.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:36 smithi063 bash[35391]: cluster 2024-02-22T19:11:35.532375+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:37.621 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-02-22T19:11:38.216 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2024-02-22T19:11:38.216 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.a smithi062 running (2m) 2m ago 3m docker.io/prom/alertmanager:latest 9f27df16978d 898c40402160 2024-02-22T19:11:38.216 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.a smithi063 running (3m) 2m ago 3m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c 9863e2980fa6 2024-02-22T19:11:38.216 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.x smithi063 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ab327e92079c 2024-02-22T19:11:38.216 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.y smithi062 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a701a128b9c 2024-02-22T19:11:38.216 INFO:teuthology.orchestra.run.smithi062.stdout:mon.a smithi062 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 edca537a955b 2024-02-22T19:11:38.217 INFO:teuthology.orchestra.run.smithi062.stdout:mon.b smithi063 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 deb740d884ca 2024-02-22T19:11:38.217 INFO:teuthology.orchestra.run.smithi062.stdout:mon.c smithi062 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 921b06886416 2024-02-22T19:11:38.217 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.a smithi062 running (3m) 2m ago 3m docker.io/prom/node-exporter:latest 72c9c2088986 3e27c560bf7f 2024-02-22T19:11:38.217 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.b smithi063 running (3m) 2m ago 3m docker.io/prom/node-exporter:latest 72c9c2088986 ab2867e3fd57 2024-02-22T19:11:38.217 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 e651beecc87d 2024-02-22T19:11:38.217 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d7a667155c4b 2024-02-22T19:11:38.217 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 dc5ec198f96d 2024-02-22T19:11:38.217 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi062 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 efb44063d52f 2024-02-22T19:11:38.217 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi063 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0affbe803c22 2024-02-22T19:11:38.217 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi063 running (4m) 2m ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 636665ed6108 2024-02-22T19:11:38.217 INFO:teuthology.orchestra.run.smithi062.stdout:osd.6 smithi063 running (4m) 2m ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8c48e05bc7dd 2024-02-22T19:11:38.217 INFO:teuthology.orchestra.run.smithi062.stdout:osd.7 smithi063 running (4m) 2m ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 c298ad18c8bb 2024-02-22T19:11:38.217 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.a smithi063 running (2m) 2m ago 3m docker.io/prom/prometheus:latest 38c53d8da784 df5dba6a5dc9 2024-02-22T19:11:38.217 INFO:teuthology.orchestra.run.smithi062.stdout:rgw.r.z.smithi062.zxmpna smithi062 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 45553891c2c4 2024-02-22T19:11:38.217 INFO:teuthology.orchestra.run.smithi062.stdout:rgw.r.z.smithi063.feyald smithi063 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 478364f15ee3 2024-02-22T19:11:38.546 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-22T19:11:38.546 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-02-22T19:11:38.546 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-22T19:11:38.546 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:11:38.546 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-02-22T19:11:38.546 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-22T19:11:38.546 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:11:38.546 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-02-22T19:11:38.546 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-22T19:11:38.546 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:11:38.546 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": {}, 2024-02-22T19:11:38.546 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw": { 2024-02-22T19:11:38.546 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-22T19:11:38.546 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:11:38.547 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-02-22T19:11:38.547 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 15 2024-02-22T19:11:38.547 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-02-22T19:11:38.547 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-22T19:11:38.845 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-22T19:11:38.845 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", 2024-02-22T19:11:38.845 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-02-22T19:11:38.845 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [], 2024-02-22T19:11:38.845 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "" 2024-02-22T19:11:38.845 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-22T19:11:38.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:38 smithi063 bash[35391]: cluster 2024-02-22T19:11:37.532835+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:38.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:38 smithi063 bash[35391]: audit 2024-02-22T19:11:38.545819+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.62:0/4274483860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:11:38.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:38 smithi062 bash[64101]: cluster 2024-02-22T19:11:37.532835+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:38.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:38 smithi062 bash[64101]: audit 2024-02-22T19:11:38.545819+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.62:0/4274483860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:11:38.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:38 smithi062 bash[67442]: cluster 2024-02-22T19:11:37.532835+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:38.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:38 smithi062 bash[67442]: audit 2024-02-22T19:11:38.545819+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.62:0/4274483860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:11:39.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:39 smithi063 bash[35391]: audit 2024-02-22T19:11:37.609894+0000 mgr.y (mgr.14140) 302 : audit [DBG] from='client.14727 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:11:39.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:39 smithi063 bash[35391]: audit 2024-02-22T19:11:37.915034+0000 mgr.y (mgr.14140) 303 : audit [DBG] from='client.24643 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:11:39.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:39 smithi063 bash[35391]: audit 2024-02-22T19:11:38.212454+0000 mgr.y (mgr.14140) 304 : audit [DBG] from='client.24649 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:11:39.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:39 smithi062 bash[64101]: audit 2024-02-22T19:11:37.609894+0000 mgr.y (mgr.14140) 302 : audit [DBG] from='client.14727 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:11:39.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:39 smithi062 bash[64101]: audit 2024-02-22T19:11:37.915034+0000 mgr.y (mgr.14140) 303 : audit [DBG] from='client.24643 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:11:39.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:39 smithi062 bash[64101]: audit 2024-02-22T19:11:38.212454+0000 mgr.y (mgr.14140) 304 : audit [DBG] from='client.24649 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:11:39.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:39 smithi062 bash[67442]: audit 2024-02-22T19:11:37.609894+0000 mgr.y (mgr.14140) 302 : audit [DBG] from='client.14727 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:11:39.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:39 smithi062 bash[67442]: audit 2024-02-22T19:11:37.915034+0000 mgr.y (mgr.14140) 303 : audit [DBG] from='client.24643 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:11:39.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:39 smithi062 bash[67442]: audit 2024-02-22T19:11:38.212454+0000 mgr.y (mgr.14140) 304 : audit [DBG] from='client.24649 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:11:40.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:40 smithi063 bash[35391]: audit 2024-02-22T19:11:38.844466+0000 mgr.y (mgr.14140) 305 : audit [DBG] from='client.24661 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:11:40.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:40 smithi063 bash[35391]: cluster 2024-02-22T19:11:39.533260+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:40.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:40 smithi062 bash[64101]: audit 2024-02-22T19:11:38.844466+0000 mgr.y (mgr.14140) 305 : audit [DBG] from='client.24661 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:11:40.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:40 smithi062 bash[64101]: cluster 2024-02-22T19:11:39.533260+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:40.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:40 smithi062 bash[67442]: audit 2024-02-22T19:11:38.844466+0000 mgr.y (mgr.14140) 305 : audit [DBG] from='client.24661 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:11:40.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:40 smithi062 bash[67442]: cluster 2024-02-22T19:11:39.533260+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:42.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:42 smithi063 bash[35391]: cluster 2024-02-22T19:11:41.533825+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:42.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:42 smithi062 bash[64101]: cluster 2024-02-22T19:11:41.533825+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:42.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:42 smithi062 bash[67442]: cluster 2024-02-22T19:11:41.533825+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:44.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:44 smithi063 bash[35391]: cluster 2024-02-22T19:11:43.534244+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:44.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:44 smithi062 bash[64101]: cluster 2024-02-22T19:11:43.534244+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:44.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:44 smithi062 bash[67442]: cluster 2024-02-22T19:11:43.534244+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:46.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:46 smithi063 bash[35391]: cluster 2024-02-22T19:11:45.534596+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:46.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:46 smithi062 bash[64101]: cluster 2024-02-22T19:11:45.534596+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:46.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:46 smithi062 bash[67442]: cluster 2024-02-22T19:11:45.534596+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:48.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:48 smithi063 bash[35391]: cluster 2024-02-22T19:11:47.535126+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:48.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:48 smithi062 bash[64101]: cluster 2024-02-22T19:11:47.535126+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:48.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:48 smithi062 bash[67442]: cluster 2024-02-22T19:11:47.535126+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:50.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:50 smithi063 bash[35391]: cluster 2024-02-22T19:11:49.535604+0000 mgr.y (mgr.14140) 311 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:50.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:50 smithi062 bash[64101]: cluster 2024-02-22T19:11:49.535604+0000 mgr.y (mgr.14140) 311 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:50.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:50 smithi062 bash[67442]: cluster 2024-02-22T19:11:49.535604+0000 mgr.y (mgr.14140) 311 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:52.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:52 smithi063 bash[35391]: cluster 2024-02-22T19:11:51.536239+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:52.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:52 smithi062 bash[64101]: cluster 2024-02-22T19:11:51.536239+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:52.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:52 smithi062 bash[67442]: cluster 2024-02-22T19:11:51.536239+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:54.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:54 smithi063 bash[35391]: cluster 2024-02-22T19:11:53.536912+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:54.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:54 smithi062 bash[64101]: cluster 2024-02-22T19:11:53.536912+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:54.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:54 smithi062 bash[67442]: cluster 2024-02-22T19:11:53.536912+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:56.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:56 smithi063 bash[35391]: cluster 2024-02-22T19:11:55.537342+0000 mgr.y (mgr.14140) 314 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:56.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:56 smithi062 bash[64101]: cluster 2024-02-22T19:11:55.537342+0000 mgr.y (mgr.14140) 314 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:56.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:56 smithi062 bash[67442]: cluster 2024-02-22T19:11:55.537342+0000 mgr.y (mgr.14140) 314 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:58.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:11:58 smithi063 bash[35391]: cluster 2024-02-22T19:11:57.537930+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:58.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:11:58 smithi062 bash[64101]: cluster 2024-02-22T19:11:57.537930+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:11:58.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:11:58 smithi062 bash[67442]: cluster 2024-02-22T19:11:57.537930+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:00.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:00 smithi063 bash[35391]: cluster 2024-02-22T19:11:59.538375+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:00.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:00 smithi062 bash[64101]: cluster 2024-02-22T19:11:59.538375+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:00.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:00 smithi062 bash[67442]: cluster 2024-02-22T19:11:59.538375+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:02.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:02 smithi063 bash[35391]: cluster 2024-02-22T19:12:01.538882+0000 mgr.y (mgr.14140) 317 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:02.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:02 smithi062 bash[64101]: cluster 2024-02-22T19:12:01.538882+0000 mgr.y (mgr.14140) 317 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:02.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:02 smithi062 bash[67442]: cluster 2024-02-22T19:12:01.538882+0000 mgr.y (mgr.14140) 317 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:04.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:04 smithi063 bash[35391]: cluster 2024-02-22T19:12:03.539297+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:04.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:04 smithi062 bash[64101]: cluster 2024-02-22T19:12:03.539297+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:04.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:04 smithi062 bash[67442]: cluster 2024-02-22T19:12:03.539297+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:06.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:06 smithi063 bash[35391]: cluster 2024-02-22T19:12:05.539741+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:06.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:06 smithi063 bash[35391]: audit 2024-02-22T19:12:06.519704+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\", \"target_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"target_version\": \"ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)\"}"}]: dispatch 2024-02-22T19:12:06.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:06 smithi063 bash[35391]: audit 2024-02-22T19:12:06.522721+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\", \"target_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"target_version\": \"ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)\"}"}]': finished 2024-02-22T19:12:06.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:06 smithi063 bash[35391]: audit 2024-02-22T19:12:06.523272+0000 mon.a (mon.0) 584 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:12:06.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:06 smithi062 bash[64101]: cluster 2024-02-22T19:12:05.539741+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:06.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:06 smithi062 bash[64101]: audit 2024-02-22T19:12:06.519704+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\", \"target_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"target_version\": \"ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)\"}"}]: dispatch 2024-02-22T19:12:06.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:06 smithi062 bash[64101]: audit 2024-02-22T19:12:06.522721+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\", \"target_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"target_version\": \"ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)\"}"}]': finished 2024-02-22T19:12:06.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:06 smithi062 bash[64101]: audit 2024-02-22T19:12:06.523272+0000 mon.a (mon.0) 584 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:12:06.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:06 smithi062 bash[67442]: cluster 2024-02-22T19:12:05.539741+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:06.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:06 smithi062 bash[67442]: audit 2024-02-22T19:12:06.519704+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\", \"target_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"target_version\": \"ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)\"}"}]: dispatch 2024-02-22T19:12:06.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:06 smithi062 bash[67442]: audit 2024-02-22T19:12:06.522721+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\", \"target_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"target_version\": \"ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)\"}"}]': finished 2024-02-22T19:12:06.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:06 smithi062 bash[67442]: audit 2024-02-22T19:12:06.523272+0000 mon.a (mon.0) 584 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:12:07.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:07 smithi063 bash[35391]: cephadm 2024-02-22T19:12:06.523037+0000 mgr.y (mgr.14140) 320 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 with id 7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550 2024-02-22T19:12:07.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:07 smithi063 bash[35391]: cephadm 2024-02-22T19:12:06.524067+0000 mgr.y (mgr.14140) 321 : cephadm [INF] Upgrade: Checking mgr daemons... 2024-02-22T19:12:07.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:07 smithi063 bash[35391]: cephadm 2024-02-22T19:12:06.524345+0000 mgr.y (mgr.14140) 322 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2024-02-22T19:12:07.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:07 smithi062 bash[64101]: cephadm 2024-02-22T19:12:06.523037+0000 mgr.y (mgr.14140) 320 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 with id 7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550 2024-02-22T19:12:07.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:07 smithi062 bash[64101]: cephadm 2024-02-22T19:12:06.524067+0000 mgr.y (mgr.14140) 321 : cephadm [INF] Upgrade: Checking mgr daemons... 2024-02-22T19:12:07.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:07 smithi062 bash[64101]: cephadm 2024-02-22T19:12:06.524345+0000 mgr.y (mgr.14140) 322 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2024-02-22T19:12:07.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:07 smithi062 bash[67442]: cephadm 2024-02-22T19:12:06.523037+0000 mgr.y (mgr.14140) 320 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 with id 7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550 2024-02-22T19:12:07.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:07 smithi062 bash[67442]: cephadm 2024-02-22T19:12:06.524067+0000 mgr.y (mgr.14140) 321 : cephadm [INF] Upgrade: Checking mgr daemons... 2024-02-22T19:12:07.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:07 smithi062 bash[67442]: cephadm 2024-02-22T19:12:06.524345+0000 mgr.y (mgr.14140) 322 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2024-02-22T19:12:08.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:08 smithi063 bash[35391]: cephadm 2024-02-22T19:12:06.765896+0000 mgr.y (mgr.14140) 323 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 on smithi063 2024-02-22T19:12:08.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:08 smithi063 bash[35391]: cluster 2024-02-22T19:12:07.540247+0000 mgr.y (mgr.14140) 324 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:08.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:08 smithi062 bash[64101]: cephadm 2024-02-22T19:12:06.765896+0000 mgr.y (mgr.14140) 323 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 on smithi063 2024-02-22T19:12:08.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:08 smithi062 bash[64101]: cluster 2024-02-22T19:12:07.540247+0000 mgr.y (mgr.14140) 324 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:08.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:08 smithi062 bash[67442]: cephadm 2024-02-22T19:12:06.765896+0000 mgr.y (mgr.14140) 323 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 on smithi063 2024-02-22T19:12:08.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:08 smithi062 bash[67442]: cluster 2024-02-22T19:12:07.540247+0000 mgr.y (mgr.14140) 324 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:09.157 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-02-22T19:12:09.710 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2024-02-22T19:12:09.710 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.a smithi062 running (3m) 2m ago 4m docker.io/prom/alertmanager:latest 9f27df16978d 898c40402160 2024-02-22T19:12:09.710 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.a smithi063 running (3m) 2m ago 3m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c 9863e2980fa6 2024-02-22T19:12:09.710 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.x smithi063 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ab327e92079c 2024-02-22T19:12:09.710 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.y smithi062 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a701a128b9c 2024-02-22T19:12:09.710 INFO:teuthology.orchestra.run.smithi062.stdout:mon.a smithi062 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 edca537a955b 2024-02-22T19:12:09.710 INFO:teuthology.orchestra.run.smithi062.stdout:mon.b smithi063 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 deb740d884ca 2024-02-22T19:12:09.710 INFO:teuthology.orchestra.run.smithi062.stdout:mon.c smithi062 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 921b06886416 2024-02-22T19:12:09.711 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.a smithi062 running (4m) 2m ago 4m docker.io/prom/node-exporter:latest 72c9c2088986 3e27c560bf7f 2024-02-22T19:12:09.711 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.b smithi063 running (4m) 2m ago 4m docker.io/prom/node-exporter:latest 72c9c2088986 ab2867e3fd57 2024-02-22T19:12:09.711 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (6m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 e651beecc87d 2024-02-22T19:12:09.711 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d7a667155c4b 2024-02-22T19:12:09.711 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 dc5ec198f96d 2024-02-22T19:12:09.711 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi062 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 efb44063d52f 2024-02-22T19:12:09.711 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi063 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0affbe803c22 2024-02-22T19:12:09.711 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi063 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 636665ed6108 2024-02-22T19:12:09.711 INFO:teuthology.orchestra.run.smithi062.stdout:osd.6 smithi063 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8c48e05bc7dd 2024-02-22T19:12:09.711 INFO:teuthology.orchestra.run.smithi062.stdout:osd.7 smithi063 running (4m) 2m ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 c298ad18c8bb 2024-02-22T19:12:09.711 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.a smithi063 running (3m) 2m ago 4m docker.io/prom/prometheus:latest 38c53d8da784 df5dba6a5dc9 2024-02-22T19:12:09.711 INFO:teuthology.orchestra.run.smithi062.stdout:rgw.r.z.smithi062.zxmpna smithi062 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 45553891c2c4 2024-02-22T19:12:09.711 INFO:teuthology.orchestra.run.smithi062.stdout:rgw.r.z.smithi063.feyald smithi063 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 478364f15ee3 2024-02-22T19:12:10.014 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-22T19:12:10.014 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-02-22T19:12:10.014 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-22T19:12:10.014 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:12:10.014 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-02-22T19:12:10.014 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-22T19:12:10.014 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:12:10.014 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-02-22T19:12:10.015 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-22T19:12:10.015 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:12:10.015 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": {}, 2024-02-22T19:12:10.015 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw": { 2024-02-22T19:12:10.015 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-22T19:12:10.015 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:12:10.015 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-02-22T19:12:10.015 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 15 2024-02-22T19:12:10.015 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-02-22T19:12:10.015 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-22T19:12:10.302 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-22T19:12:10.302 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", 2024-02-22T19:12:10.303 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-02-22T19:12:10.303 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [], 2024-02-22T19:12:10.303 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "" 2024-02-22T19:12:10.303 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-22T19:12:10.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:10 smithi063 bash[35391]: audit 2024-02-22T19:12:09.145300+0000 mgr.y (mgr.14140) 325 : audit [DBG] from='client.24667 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:10.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:10 smithi063 bash[35391]: audit 2024-02-22T19:12:09.426530+0000 mgr.y (mgr.14140) 326 : audit [DBG] from='client.24673 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:10.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:10 smithi063 bash[35391]: cluster 2024-02-22T19:12:09.540745+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:10.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:10 smithi063 bash[35391]: audit 2024-02-22T19:12:10.014340+0000 mon.a (mon.0) 585 : audit [DBG] from='client.? 172.21.15.62:0/1795441159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:12:10.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:10 smithi062 bash[64101]: audit 2024-02-22T19:12:09.145300+0000 mgr.y (mgr.14140) 325 : audit [DBG] from='client.24667 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:10.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:10 smithi062 bash[64101]: audit 2024-02-22T19:12:09.426530+0000 mgr.y (mgr.14140) 326 : audit [DBG] from='client.24673 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:10.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:10 smithi062 bash[64101]: cluster 2024-02-22T19:12:09.540745+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:10.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:10 smithi062 bash[64101]: audit 2024-02-22T19:12:10.014340+0000 mon.a (mon.0) 585 : audit [DBG] from='client.? 172.21.15.62:0/1795441159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:12:10.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:10 smithi062 bash[67442]: audit 2024-02-22T19:12:09.145300+0000 mgr.y (mgr.14140) 325 : audit [DBG] from='client.24667 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:10.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:10 smithi062 bash[67442]: audit 2024-02-22T19:12:09.426530+0000 mgr.y (mgr.14140) 326 : audit [DBG] from='client.24673 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:10.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:10 smithi062 bash[67442]: cluster 2024-02-22T19:12:09.540745+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:10.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:10 smithi062 bash[67442]: audit 2024-02-22T19:12:10.014340+0000 mon.a (mon.0) 585 : audit [DBG] from='client.? 172.21.15.62:0/1795441159' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:12:11.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:11 smithi063 bash[35391]: audit 2024-02-22T19:12:09.706655+0000 mgr.y (mgr.14140) 328 : audit [DBG] from='client.24679 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:11.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:11 smithi063 bash[35391]: audit 2024-02-22T19:12:10.302112+0000 mgr.y (mgr.14140) 329 : audit [DBG] from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:11.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:11 smithi062 bash[64101]: audit 2024-02-22T19:12:09.706655+0000 mgr.y (mgr.14140) 328 : audit [DBG] from='client.24679 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:11.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:11 smithi062 bash[64101]: audit 2024-02-22T19:12:10.302112+0000 mgr.y (mgr.14140) 329 : audit [DBG] from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:11.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:11 smithi062 bash[67442]: audit 2024-02-22T19:12:09.706655+0000 mgr.y (mgr.14140) 328 : audit [DBG] from='client.24679 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:11.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:11 smithi062 bash[67442]: audit 2024-02-22T19:12:10.302112+0000 mgr.y (mgr.14140) 329 : audit [DBG] from='client.14778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:12.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:12 smithi063 bash[35391]: cluster 2024-02-22T19:12:11.541279+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:12.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:12 smithi062 bash[64101]: cluster 2024-02-22T19:12:11.541279+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:12.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:12 smithi062 bash[67442]: cluster 2024-02-22T19:12:11.541279+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:14.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:14 smithi063 bash[35391]: cluster 2024-02-22T19:12:13.541816+0000 mgr.y (mgr.14140) 331 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:14.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:14 smithi062 bash[64101]: cluster 2024-02-22T19:12:13.541816+0000 mgr.y (mgr.14140) 331 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:14.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:14 smithi062 bash[67442]: cluster 2024-02-22T19:12:13.541816+0000 mgr.y (mgr.14140) 331 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:16.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:16 smithi063 bash[35391]: cluster 2024-02-22T19:12:15.542233+0000 mgr.y (mgr.14140) 332 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:16.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:16 smithi062 bash[64101]: cluster 2024-02-22T19:12:15.542233+0000 mgr.y (mgr.14140) 332 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:16.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:16 smithi062 bash[67442]: cluster 2024-02-22T19:12:15.542233+0000 mgr.y (mgr.14140) 332 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:18.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:18 smithi063 bash[35391]: cluster 2024-02-22T19:12:17.542831+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:18.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:18 smithi062 bash[64101]: cluster 2024-02-22T19:12:17.542831+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:18.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:18 smithi062 bash[67442]: cluster 2024-02-22T19:12:17.542831+0000 mgr.y (mgr.14140) 333 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:20.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:20 smithi063 bash[35391]: cluster 2024-02-22T19:12:19.543542+0000 mgr.y (mgr.14140) 334 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:20.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:20 smithi062 bash[64101]: cluster 2024-02-22T19:12:19.543542+0000 mgr.y (mgr.14140) 334 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:20.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:20 smithi062 bash[67442]: cluster 2024-02-22T19:12:19.543542+0000 mgr.y (mgr.14140) 334 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:22.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:22 smithi063 bash[35391]: cluster 2024-02-22T19:12:21.544185+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:22.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:22 smithi062 bash[64101]: cluster 2024-02-22T19:12:21.544185+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:22.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:22 smithi062 bash[67442]: cluster 2024-02-22T19:12:21.544185+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:24.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:24 smithi063 bash[35391]: cluster 2024-02-22T19:12:23.544851+0000 mgr.y (mgr.14140) 336 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:24.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:24 smithi062 bash[64101]: cluster 2024-02-22T19:12:23.544851+0000 mgr.y (mgr.14140) 336 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:24.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:24 smithi062 bash[67442]: cluster 2024-02-22T19:12:23.544851+0000 mgr.y (mgr.14140) 336 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:26.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:26 smithi063 bash[35391]: cluster 2024-02-22T19:12:25.545270+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:26.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:26 smithi062 bash[64101]: cluster 2024-02-22T19:12:25.545270+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:26.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:26 smithi062 bash[67442]: cluster 2024-02-22T19:12:25.545270+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:28.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:28 smithi063 bash[35391]: cluster 2024-02-22T19:12:27.545978+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:28.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:28 smithi062 bash[64101]: cluster 2024-02-22T19:12:27.545978+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:28.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:28 smithi062 bash[67442]: cluster 2024-02-22T19:12:27.545978+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:30.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:30 smithi063 bash[35391]: cluster 2024-02-22T19:12:29.546783+0000 mgr.y (mgr.14140) 339 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:30.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:30 smithi062 bash[64101]: cluster 2024-02-22T19:12:29.546783+0000 mgr.y (mgr.14140) 339 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:30.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:30 smithi062 bash[67442]: cluster 2024-02-22T19:12:29.546783+0000 mgr.y (mgr.14140) 339 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:32.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:32 smithi063 bash[35391]: cluster 2024-02-22T19:12:31.547342+0000 mgr.y (mgr.14140) 340 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:32.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:32 smithi062 bash[64101]: cluster 2024-02-22T19:12:31.547342+0000 mgr.y (mgr.14140) 340 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:32.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:32 smithi062 bash[67442]: cluster 2024-02-22T19:12:31.547342+0000 mgr.y (mgr.14140) 340 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:34.901 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:34 smithi063 bash[35391]: cluster 2024-02-22T19:12:33.547899+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:34.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:34 smithi062 bash[64101]: cluster 2024-02-22T19:12:33.547899+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:34.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:34 smithi062 bash[67442]: cluster 2024-02-22T19:12:33.547899+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:36.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:36 smithi063 bash[35391]: cluster 2024-02-22T19:12:35.548423+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:36.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:36 smithi063 bash[35391]: audit 2024-02-22T19:12:35.967731+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "who": "mgr.x"}]: dispatch 2024-02-22T19:12:36.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:36 smithi063 bash[35391]: audit 2024-02-22T19:12:35.974501+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "who": "mgr.x"}]': finished 2024-02-22T19:12:36.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:36 smithi063 bash[35391]: audit 2024-02-22T19:12:35.975449+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2024-02-22T19:12:36.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:36 smithi063 bash[35391]: audit 2024-02-22T19:12:35.976262+0000 mon.a (mon.0) 589 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:12:36.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:36 smithi063 bash[35391]: audit 2024-02-22T19:12:35.977296+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-22T19:12:36.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:36 smithi062 bash[64101]: cluster 2024-02-22T19:12:35.548423+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:36.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:36 smithi062 bash[64101]: audit 2024-02-22T19:12:35.967731+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "who": "mgr.x"}]: dispatch 2024-02-22T19:12:36.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:36 smithi062 bash[64101]: audit 2024-02-22T19:12:35.974501+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "who": "mgr.x"}]': finished 2024-02-22T19:12:36.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:36 smithi062 bash[64101]: audit 2024-02-22T19:12:35.975449+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2024-02-22T19:12:36.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:36 smithi062 bash[64101]: audit 2024-02-22T19:12:35.976262+0000 mon.a (mon.0) 589 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:12:36.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:36 smithi062 bash[64101]: audit 2024-02-22T19:12:35.977296+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-22T19:12:36.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:36 smithi062 bash[67442]: cluster 2024-02-22T19:12:35.548423+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:36.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:36 smithi062 bash[67442]: audit 2024-02-22T19:12:35.967731+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "who": "mgr.x"}]: dispatch 2024-02-22T19:12:36.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:36 smithi062 bash[67442]: audit 2024-02-22T19:12:35.974501+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", "who": "mgr.x"}]': finished 2024-02-22T19:12:36.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:36 smithi062 bash[67442]: audit 2024-02-22T19:12:35.975449+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2024-02-22T19:12:36.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:36 smithi062 bash[67442]: audit 2024-02-22T19:12:35.976262+0000 mon.a (mon.0) 589 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:12:36.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:36 smithi062 bash[67442]: audit 2024-02-22T19:12:35.977296+0000 mon.a (mon.0) 590 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-22T19:12:37.714 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:37 smithi063 systemd[1]: Stopping Ceph mgr.x for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:12:37.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:37 smithi063 bash[35391]: cephadm 2024-02-22T19:12:35.967295+0000 mgr.y (mgr.14140) 343 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2024-02-22T19:12:37.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:37 smithi063 bash[35391]: cephadm 2024-02-22T19:12:35.967364+0000 mgr.y (mgr.14140) 344 : cephadm [INF] Upgrade: Redeploying mgr.x 2024-02-22T19:12:37.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:37 smithi063 bash[35391]: cephadm 2024-02-22T19:12:35.976884+0000 mgr.y (mgr.14140) 345 : cephadm [INF] Deploying daemon mgr.x on smithi063 2024-02-22T19:12:37.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:37 smithi062 bash[64101]: cephadm 2024-02-22T19:12:35.967295+0000 mgr.y (mgr.14140) 343 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2024-02-22T19:12:37.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:37 smithi062 bash[64101]: cephadm 2024-02-22T19:12:35.967364+0000 mgr.y (mgr.14140) 344 : cephadm [INF] Upgrade: Redeploying mgr.x 2024-02-22T19:12:37.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:37 smithi062 bash[64101]: cephadm 2024-02-22T19:12:35.976884+0000 mgr.y (mgr.14140) 345 : cephadm [INF] Deploying daemon mgr.x on smithi063 2024-02-22T19:12:37.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:37 smithi062 bash[67442]: cephadm 2024-02-22T19:12:35.967295+0000 mgr.y (mgr.14140) 343 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2024-02-22T19:12:37.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:37 smithi062 bash[67442]: cephadm 2024-02-22T19:12:35.967364+0000 mgr.y (mgr.14140) 344 : cephadm [INF] Upgrade: Redeploying mgr.x 2024-02-22T19:12:37.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:37 smithi062 bash[67442]: cephadm 2024-02-22T19:12:35.976884+0000 mgr.y (mgr.14140) 345 : cephadm [INF] Deploying daemon mgr.x on smithi063 2024-02-22T19:12:38.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:38 smithi063 bash[35391]: cluster 2024-02-22T19:12:37.549113+0000 mgr.y (mgr.14140) 346 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:38.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:38 smithi062 bash[64101]: cluster 2024-02-22T19:12:37.549113+0000 mgr.y (mgr.14140) 346 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:38.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:38 smithi062 bash[67442]: cluster 2024-02-22T19:12:37.549113+0000 mgr.y (mgr.14140) 346 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:40.613 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-02-22T19:12:40.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:40 smithi063 bash[35391]: cluster 2024-02-22T19:12:39.549762+0000 mgr.y (mgr.14140) 347 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:40.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:40 smithi062 bash[64101]: cluster 2024-02-22T19:12:39.549762+0000 mgr.y (mgr.14140) 347 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:40.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:40 smithi062 bash[67442]: cluster 2024-02-22T19:12:39.549762+0000 mgr.y (mgr.14140) 347 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:41.162 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2024-02-22T19:12:41.162 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.a smithi062 running (3m) 3m ago 4m docker.io/prom/alertmanager:latest 9f27df16978d 898c40402160 2024-02-22T19:12:41.162 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.a smithi063 running (4m) 3m ago 4m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c 9863e2980fa6 2024-02-22T19:12:41.162 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.x smithi063 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ab327e92079c 2024-02-22T19:12:41.162 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.y smithi062 running (9m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5a701a128b9c 2024-02-22T19:12:41.162 INFO:teuthology.orchestra.run.smithi062.stdout:mon.a smithi062 running (9m) 3m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 edca537a955b 2024-02-22T19:12:41.163 INFO:teuthology.orchestra.run.smithi062.stdout:mon.b smithi063 running (8m) 3m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 deb740d884ca 2024-02-22T19:12:41.163 INFO:teuthology.orchestra.run.smithi062.stdout:mon.c smithi062 running (8m) 3m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 921b06886416 2024-02-22T19:12:41.163 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.a smithi062 running (4m) 3m ago 4m docker.io/prom/node-exporter:latest 72c9c2088986 3e27c560bf7f 2024-02-22T19:12:41.163 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.b smithi063 running (4m) 3m ago 4m docker.io/prom/node-exporter:latest 72c9c2088986 ab2867e3fd57 2024-02-22T19:12:41.163 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 e651beecc87d 2024-02-22T19:12:41.163 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d7a667155c4b 2024-02-22T19:12:41.163 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (6m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 dc5ec198f96d 2024-02-22T19:12:41.163 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi062 running (6m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 efb44063d52f 2024-02-22T19:12:41.163 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi063 running (6m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0affbe803c22 2024-02-22T19:12:41.163 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi063 running (5m) 3m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 636665ed6108 2024-02-22T19:12:41.163 INFO:teuthology.orchestra.run.smithi062.stdout:osd.6 smithi063 running (5m) 3m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 8c48e05bc7dd 2024-02-22T19:12:41.164 INFO:teuthology.orchestra.run.smithi062.stdout:osd.7 smithi063 running (5m) 3m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 c298ad18c8bb 2024-02-22T19:12:41.164 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.a smithi063 running (3m) 3m ago 4m docker.io/prom/prometheus:latest 38c53d8da784 df5dba6a5dc9 2024-02-22T19:12:41.164 INFO:teuthology.orchestra.run.smithi062.stdout:rgw.r.z.smithi062.zxmpna smithi062 running (3m) 3m ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 45553891c2c4 2024-02-22T19:12:41.164 INFO:teuthology.orchestra.run.smithi062.stdout:rgw.r.z.smithi063.feyald smithi063 running (3m) 3m ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 478364f15ee3 2024-02-22T19:12:41.463 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-22T19:12:41.463 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-02-22T19:12:41.464 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-22T19:12:41.464 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:12:41.464 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-02-22T19:12:41.464 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-22T19:12:41.464 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:12:41.464 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-02-22T19:12:41.464 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-22T19:12:41.464 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:12:41.464 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": {}, 2024-02-22T19:12:41.464 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw": { 2024-02-22T19:12:41.464 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-22T19:12:41.465 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:12:41.465 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-02-22T19:12:41.465 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 15 2024-02-22T19:12:41.465 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-02-22T19:12:41.465 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-22T19:12:41.748 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-22T19:12:41.749 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", 2024-02-22T19:12:41.749 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-02-22T19:12:41.749 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [], 2024-02-22T19:12:41.749 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "" 2024-02-22T19:12:41.749 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-22T19:12:41.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:41 smithi063 bash[35391]: audit 2024-02-22T19:12:40.602326+0000 mgr.y (mgr.14140) 348 : audit [DBG] from='client.24697 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:41.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:41 smithi063 bash[35391]: audit 2024-02-22T19:12:41.463259+0000 mon.a (mon.0) 591 : audit [DBG] from='client.? 172.21.15.62:0/1448803006' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:12:41.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:41 smithi062 bash[64101]: audit 2024-02-22T19:12:40.602326+0000 mgr.y (mgr.14140) 348 : audit [DBG] from='client.24697 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:41.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:41 smithi062 bash[64101]: audit 2024-02-22T19:12:41.463259+0000 mon.a (mon.0) 591 : audit [DBG] from='client.? 172.21.15.62:0/1448803006' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:12:41.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:41 smithi062 bash[67442]: audit 2024-02-22T19:12:40.602326+0000 mgr.y (mgr.14140) 348 : audit [DBG] from='client.24697 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:41.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:41 smithi062 bash[67442]: audit 2024-02-22T19:12:41.463259+0000 mon.a (mon.0) 591 : audit [DBG] from='client.? 172.21.15.62:0/1448803006' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:12:42.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:42 smithi063 bash[35391]: audit 2024-02-22T19:12:40.882734+0000 mgr.y (mgr.14140) 349 : audit [DBG] from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:42.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:42 smithi063 bash[35391]: audit 2024-02-22T19:12:41.158284+0000 mgr.y (mgr.14140) 350 : audit [DBG] from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:42.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:42 smithi063 bash[35391]: cluster 2024-02-22T19:12:41.550353+0000 mgr.y (mgr.14140) 351 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:42.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:42 smithi062 bash[64101]: audit 2024-02-22T19:12:40.882734+0000 mgr.y (mgr.14140) 349 : audit [DBG] from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:42.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:42 smithi062 bash[64101]: audit 2024-02-22T19:12:41.158284+0000 mgr.y (mgr.14140) 350 : audit [DBG] from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:42.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:42 smithi062 bash[64101]: cluster 2024-02-22T19:12:41.550353+0000 mgr.y (mgr.14140) 351 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:42.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:42 smithi062 bash[67442]: audit 2024-02-22T19:12:40.882734+0000 mgr.y (mgr.14140) 349 : audit [DBG] from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:42.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:42 smithi062 bash[67442]: audit 2024-02-22T19:12:41.158284+0000 mgr.y (mgr.14140) 350 : audit [DBG] from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:42.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:42 smithi062 bash[67442]: cluster 2024-02-22T19:12:41.550353+0000 mgr.y (mgr.14140) 351 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:43.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:43 smithi063 bash[35391]: audit 2024-02-22T19:12:41.748412+0000 mgr.y (mgr.14140) 352 : audit [DBG] from='client.24721 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:43.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:43 smithi062 bash[64101]: audit 2024-02-22T19:12:41.748412+0000 mgr.y (mgr.14140) 352 : audit [DBG] from='client.24721 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:43.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:43 smithi062 bash[67442]: audit 2024-02-22T19:12:41.748412+0000 mgr.y (mgr.14140) 352 : audit [DBG] from='client.24721 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:12:44.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:44 smithi063 bash[35391]: cluster 2024-02-22T19:12:43.550828+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:44.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:44 smithi062 bash[64101]: cluster 2024-02-22T19:12:43.550828+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:44.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:44 smithi062 bash[67442]: cluster 2024-02-22T19:12:43.550828+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:46.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:46 smithi063 bash[35391]: cluster 2024-02-22T19:12:45.551284+0000 mgr.y (mgr.14140) 354 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:46.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:46 smithi062 bash[64101]: cluster 2024-02-22T19:12:45.551284+0000 mgr.y (mgr.14140) 354 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:46.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:46 smithi062 bash[67442]: cluster 2024-02-22T19:12:45.551284+0000 mgr.y (mgr.14140) 354 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:47.963 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:47 smithi063 podman[48038]: time="2024-02-22T19:12:47Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr.x in 10 seconds, resorting to SIGKILL" 2024-02-22T19:12:48.464 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:48 smithi063 podman[48038]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr.x 2024-02-22T19:12:48.464 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:48 smithi063 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mgr.x.service: Main process exited, code=exited, status=137/n/a 2024-02-22T19:12:48.464 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:48 smithi063 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mgr.x.service: Failed with result 'exit-code'. 2024-02-22T19:12:48.464 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:48 smithi063 systemd[1]: Stopped Ceph mgr.x for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:12:48.796 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:48 smithi063 bash[35391]: cluster 2024-02-22T19:12:47.551989+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:48.796 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:48 smithi063 systemd[1]: Starting Ceph mgr.x for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:12:48.796 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:48 smithi063 podman[48118]: Error: no container with ID or name "ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr.x" found: no such container 2024-02-22T19:12:48.796 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:48 smithi063 systemd[1]: Started Ceph mgr.x for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:12:48.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:48 smithi062 bash[64101]: cluster 2024-02-22T19:12:47.551989+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:48.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:48 smithi062 bash[67442]: cluster 2024-02-22T19:12:47.551989+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:49.679 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:49 smithi063 bash[48133]: debug 2024-02-22T19:12:49.254+0000 7f66dcfbe700 1 -- 172.21.15.63:0/4189963382 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561ce45da4e0 con 0x561ce45af000 2024-02-22T19:12:49.680 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:49 smithi063 bash[48133]: debug 2024-02-22T19:12:49.379+0000 7f66ed5b9680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-22T19:12:49.680 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:49 smithi063 bash[48133]: debug 2024-02-22T19:12:49.463+0000 7f66ed5b9680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-22T19:12:49.680 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:49 smithi063 bash[35391]: audit 2024-02-22T19:12:48.586690+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250513\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250664\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250704\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250738\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250770\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250802\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250835\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250867\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250900\", \"created\": \"2024-02-22T19:09:25.934973\", \"started\": \"2024-02-22T19:09:25.968393\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:12:49.680 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:49 smithi063 bash[35391]: audit 2024-02-22T19:12:48.590378+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250513\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250664\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250704\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250738\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250770\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250802\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250835\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250867\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250900\", \"created\": \"2024-02-22T19:09:25.934973\", \"started\": \"2024-02-22T19:09:25.968393\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:12:49.680 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:49 smithi063 bash[35391]: audit 2024-02-22T19:12:48.591154+0000 mon.a (mon.0) 594 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:12:49.887 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:49 smithi062 bash[64101]: audit 2024-02-22T19:12:48.586690+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250513\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250664\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250704\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250738\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250770\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250802\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250835\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250867\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250900\", \"created\": \"2024-02-22T19:09:25.934973\", \"started\": \"2024-02-22T19:09:25.968393\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:12:49.887 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:49 smithi062 bash[64101]: audit 2024-02-22T19:12:48.590378+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250513\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250664\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250704\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250738\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250770\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250802\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250835\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250867\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250900\", \"created\": \"2024-02-22T19:09:25.934973\", \"started\": \"2024-02-22T19:09:25.968393\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:12:49.887 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:49 smithi062 bash[64101]: audit 2024-02-22T19:12:48.591154+0000 mon.a (mon.0) 594 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:12:49.887 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:49 smithi062 bash[67442]: audit 2024-02-22T19:12:48.586690+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250513\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250664\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250704\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250738\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250770\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250802\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250835\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250867\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250900\", \"created\": \"2024-02-22T19:09:25.934973\", \"started\": \"2024-02-22T19:09:25.968393\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:12:49.887 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:49 smithi062 bash[67442]: audit 2024-02-22T19:12:48.590378+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250513\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250664\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250704\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250738\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250770\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250802\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250835\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250867\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:09:34.250900\", \"created\": \"2024-02-22T19:09:25.934973\", \"started\": \"2024-02-22T19:09:25.968393\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:12:49.887 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:49 smithi062 bash[67442]: audit 2024-02-22T19:12:48.591154+0000 mon.a (mon.0) 594 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-22T19:12:49.963 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:49 smithi063 bash[48133]: debug 2024-02-22T19:12:49.862+0000 7f66ed5b9680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-22T19:12:50.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:50 smithi063 bash[35391]: cluster 2024-02-22T19:12:49.552548+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:50.964 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:50 smithi063 bash[48133]: debug 2024-02-22T19:12:50.693+0000 7f66ed5b9680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-22T19:12:50.964 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:50 smithi063 bash[48133]: debug 2024-02-22T19:12:50.788+0000 7f66ed5b9680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-22T19:12:50.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:50 smithi062 bash[64101]: cluster 2024-02-22T19:12:49.552548+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:50.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:50 smithi062 bash[67442]: cluster 2024-02-22T19:12:49.552548+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:51.342 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:51 smithi063 bash[48133]: debug 2024-02-22T19:12:51.013+0000 7f66ed5b9680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-22T19:12:52.052 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:52 smithi063 bash[48133]: debug 2024-02-22T19:12:52.028+0000 7f66ed5b9680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-22T19:12:52.352 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:52 smithi063 bash[48133]: debug 2024-02-22T19:12:52.162+0000 7f66ed5b9680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-22T19:12:52.352 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:52 smithi063 bash[48133]: debug 2024-02-22T19:12:52.244+0000 7f66ed5b9680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-22T19:12:52.603 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:52 smithi063 bash[48133]: debug 2024-02-22T19:12:52.351+0000 7f66ed5b9680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-22T19:12:52.604 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:52 smithi063 bash[48133]: debug 2024-02-22T19:12:52.553+0000 7f66ed5b9680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-22T19:12:52.857 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:52 smithi063 bash[35391]: cluster 2024-02-22T19:12:51.553093+0000 mgr.y (mgr.14140) 357 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:52.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:52 smithi062 bash[64101]: cluster 2024-02-22T19:12:51.553093+0000 mgr.y (mgr.14140) 357 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:52.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:52 smithi062 bash[67442]: cluster 2024-02-22T19:12:51.553093+0000 mgr.y (mgr.14140) 357 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:53.213 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:52 smithi063 bash[48133]: debug 2024-02-22T19:12:52.856+0000 7f66ed5b9680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-22T19:12:53.213 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:52 smithi063 bash[48133]: debug 2024-02-22T19:12:52.960+0000 7f66ed5b9680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-22T19:12:53.886 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:53 smithi062 bash[64101]: audit 2024-02-22T19:12:53.153095+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151694\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151791\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:12:48.584846\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151831\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151867\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151901\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151935\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151968\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.152001\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.152034\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.152067\", \"created\": \"2024-02-22T19:09:25.934973\", \"started\": \"2024-02-22T19:09:25.968393\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_daemon_update\": \"2024-02-22T19:12:53.152165\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:12:53.886 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:53 smithi062 bash[67442]: audit 2024-02-22T19:12:53.153095+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151694\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151791\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:12:48.584846\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151831\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151867\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151901\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151935\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151968\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.152001\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.152034\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.152067\", \"created\": \"2024-02-22T19:09:25.934973\", \"started\": \"2024-02-22T19:09:25.968393\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_daemon_update\": \"2024-02-22T19:12:53.152165\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:12:53.886 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:53 smithi062 bash[67442]: audit 2024-02-22T19:12:53.156401+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151694\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151791\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:12:48.584846\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151831\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151867\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151901\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151935\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151968\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.152001\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.152034\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.152067\", \"created\": \"2024-02-22T19:09:25.934973\", \"started\": \"2024-02-22T19:09:25.968393\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_daemon_update\": \"2024-02-22T19:12:53.152165\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:12:53.887 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:53 smithi062 bash[67442]: audit 2024-02-22T19:12:53.159122+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:12:53.887 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:53 smithi062 bash[67442]: audit 2024-02-22T19:12:53.162820+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-02-22T19:12:53.887 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:53 smithi062 bash[67442]: cluster 2024-02-22T19:12:53.172679+0000 mon.a (mon.0) 599 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-22T19:12:53.887 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:53 smithi062 bash[64101]: audit 2024-02-22T19:12:53.156401+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151694\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151791\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:12:48.584846\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151831\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151867\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151901\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151935\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151968\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.152001\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.152034\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.152067\", \"created\": \"2024-02-22T19:09:25.934973\", \"started\": \"2024-02-22T19:09:25.968393\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_daemon_update\": \"2024-02-22T19:12:53.152165\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:12:53.887 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:53 smithi062 bash[64101]: audit 2024-02-22T19:12:53.159122+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:12:53.887 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:53 smithi062 bash[64101]: audit 2024-02-22T19:12:53.162820+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-02-22T19:12:53.887 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:53 smithi062 bash[64101]: cluster 2024-02-22T19:12:53.172679+0000 mon.a (mon.0) 599 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-22T19:12:53.906 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:53 smithi063 bash[48133]: debug 2024-02-22T19:12:53.726+0000 7f66ed5b9680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-22T19:12:53.906 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:53 smithi063 bash[48133]: debug 2024-02-22T19:12:53.811+0000 7f66ed5b9680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-22T19:12:53.907 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:53 smithi063 bash[35391]: audit 2024-02-22T19:12:53.153095+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151694\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151791\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:12:48.584846\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151831\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151867\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151901\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151935\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151968\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.152001\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.152034\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.152067\", \"created\": \"2024-02-22T19:09:25.934973\", \"started\": \"2024-02-22T19:09:25.968393\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_daemon_update\": \"2024-02-22T19:12:53.152165\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]: dispatch 2024-02-22T19:12:53.907 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:53 smithi063 bash[35391]: audit 2024-02-22T19:12:53.156401+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151694\", \"created\": \"2024-02-22T19:04:34.723894\", \"started\": \"2024-02-22T19:04:34.759372\"}, \"mgr.x\": {\"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151791\", \"created\": \"2024-02-22T19:04:48.649751\", \"started\": \"2024-02-22T19:12:48.584846\"}, \"osd.4\": {\"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151831\", \"created\": \"2024-02-22T19:06:21.296797\", \"started\": \"2024-02-22T19:06:24.227880\"}, \"osd.5\": {\"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151867\", \"created\": \"2024-02-22T19:06:42.104590\", \"started\": \"2024-02-22T19:06:44.713378\"}, \"osd.6\": {\"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151901\", \"created\": \"2024-02-22T19:07:01.273403\", \"started\": \"2024-02-22T19:07:03.001932\"}, \"osd.7\": {\"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151935\", \"created\": \"2024-02-22T19:07:20.668214\", \"started\": \"2024-02-22T19:07:22.324269\"}, \"prometheus.a\": {\"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.151968\", \"created\": \"2024-02-22T19:07:49.999926\", \"started\": \"2024-02-22T19:08:50.304019\"}, \"node-exporter.b\": {\"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.152001\", \"created\": \"2024-02-22T19:07:52.669900\", \"started\": \"2024-02-22T19:08:01.294641\"}, \"grafana.a\": {\"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.152034\", \"created\": \"2024-02-22T19:08:29.248540\", \"started\": \"2024-02-22T19:08:29.358742\"}, \"rgw.r.z.smithi063.feyald\": {\"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-22T19:12:53.152067\", \"created\": \"2024-02-22T19:09:25.934973\", \"started\": \"2024-02-22T19:09:25.968393\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170\"}}, \"last_daemon_update\": \"2024-02-22T19:12:53.152165\", \"last_device_update\": \"2024-02-22T19:07:26.785279\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.63\"]}, \"last_host_check\": \"2024-02-22T19:03:59.482955\"}"}]': finished 2024-02-22T19:12:53.907 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:53 smithi063 bash[35391]: audit 2024-02-22T19:12:53.159122+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:12:53.907 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:53 smithi063 bash[35391]: audit 2024-02-22T19:12:53.162820+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-02-22T19:12:53.907 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:53 smithi063 bash[35391]: cluster 2024-02-22T19:12:53.172679+0000 mon.a (mon.0) 599 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-22T19:12:54.184 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:53 smithi063 bash[48133]: debug 2024-02-22T19:12:53.905+0000 7f66ed5b9680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-22T19:12:54.184 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:54 smithi063 bash[48133]: debug 2024-02-22T19:12:54.089+0000 7f66ed5b9680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-22T19:12:54.463 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:54 smithi063 bash[48133]: debug 2024-02-22T19:12:54.360+0000 7f66ed5b9680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-22T19:12:54.484 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:12:54 smithi062 bash[64334]: debug 2024-02-22T19:12:54.156+0000 7fac89aee700 -1 mgr handle_mgr_map I was active but no longer amignoring --setuser ceph since I am not root 2024-02-22T19:12:54.484 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:12:54 smithi062 bash[64334]: ignoring --setgroup ceph since I am not root 2024-02-22T19:12:54.817 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:54 smithi063 bash[48133]: debug 2024-02-22T19:12:54.496+0000 7f66ed5b9680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-22T19:12:54.817 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:54 smithi063 bash[48133]: debug 2024-02-22T19:12:54.636+0000 7f66ed5b9680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-22T19:12:54.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:54 smithi063 bash[35391]: cephadm 2024-02-22T19:12:53.158818+0000 mgr.y (mgr.14140) 358 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 with id 7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550 2024-02-22T19:12:54.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:54 smithi063 bash[35391]: cephadm 2024-02-22T19:12:53.160131+0000 mgr.y (mgr.14140) 359 : cephadm [INF] Upgrade: Checking mgr daemons... 2024-02-22T19:12:54.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:54 smithi063 bash[35391]: cephadm 2024-02-22T19:12:53.160324+0000 mgr.y (mgr.14140) 360 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2024-02-22T19:12:54.817 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:54 smithi063 bash[35391]: cephadm 2024-02-22T19:12:53.162316+0000 mgr.y (mgr.14140) 361 : cephadm [INF] Upgrade: there are 1 other already-upgraded standby mgrs, failing over 2024-02-22T19:12:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:54 smithi063 bash[35391]: cluster 2024-02-22T19:12:53.553790+0000 mgr.y (mgr.14140) 362 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:54 smithi063 bash[35391]: audit 2024-02-22T19:12:54.160617+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-02-22T19:12:54.818 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:54 smithi063 bash[35391]: cluster 2024-02-22T19:12:54.160695+0000 mon.a (mon.0) 601 : cluster [DBG] mgrmap e15: x(active, starting, since 0.997351s) 2024-02-22T19:12:54.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:54 smithi062 bash[64101]: cephadm 2024-02-22T19:12:53.158818+0000 mgr.y (mgr.14140) 358 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 with id 7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550 2024-02-22T19:12:54.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:54 smithi062 bash[64101]: cephadm 2024-02-22T19:12:53.160131+0000 mgr.y (mgr.14140) 359 : cephadm [INF] Upgrade: Checking mgr daemons... 2024-02-22T19:12:54.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:54 smithi062 bash[64101]: cephadm 2024-02-22T19:12:53.160324+0000 mgr.y (mgr.14140) 360 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2024-02-22T19:12:54.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:54 smithi062 bash[64101]: cephadm 2024-02-22T19:12:53.162316+0000 mgr.y (mgr.14140) 361 : cephadm [INF] Upgrade: there are 1 other already-upgraded standby mgrs, failing over 2024-02-22T19:12:54.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:54 smithi062 bash[64101]: cluster 2024-02-22T19:12:53.553790+0000 mgr.y (mgr.14140) 362 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:54.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:54 smithi062 bash[64101]: audit 2024-02-22T19:12:54.160617+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-02-22T19:12:54.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:54 smithi062 bash[64101]: cluster 2024-02-22T19:12:54.160695+0000 mon.a (mon.0) 601 : cluster [DBG] mgrmap e15: x(active, starting, since 0.997351s) 2024-02-22T19:12:54.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:54 smithi062 bash[67442]: cephadm 2024-02-22T19:12:53.158818+0000 mgr.y (mgr.14140) 358 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 with id 7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550 2024-02-22T19:12:54.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:54 smithi062 bash[67442]: cephadm 2024-02-22T19:12:53.160131+0000 mgr.y (mgr.14140) 359 : cephadm [INF] Upgrade: Checking mgr daemons... 2024-02-22T19:12:54.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:54 smithi062 bash[67442]: cephadm 2024-02-22T19:12:53.160324+0000 mgr.y (mgr.14140) 360 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2024-02-22T19:12:54.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:54 smithi062 bash[67442]: cephadm 2024-02-22T19:12:53.162316+0000 mgr.y (mgr.14140) 361 : cephadm [INF] Upgrade: there are 1 other already-upgraded standby mgrs, failing over 2024-02-22T19:12:54.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:54 smithi062 bash[67442]: cluster 2024-02-22T19:12:53.553790+0000 mgr.y (mgr.14140) 362 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:12:54.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:54 smithi062 bash[67442]: audit 2024-02-22T19:12:54.160617+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14140 172.21.15.62:0/3152656437' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-02-22T19:12:54.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:54 smithi062 bash[67442]: cluster 2024-02-22T19:12:54.160695+0000 mon.a (mon.0) 601 : cluster [DBG] mgrmap e15: x(active, starting, since 0.997351s) 2024-02-22T19:12:55.213 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:54 smithi063 bash[48133]: debug 2024-02-22T19:12:54.816+0000 7f66ed5b9680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-22T19:12:55.213 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:12:54 smithi063 bash[48133]: debug 2024-02-22T19:12:54.902+0000 7f66ed5b9680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-22T19:12:55.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:55 smithi063 bash[35391]: cluster 2024-02-22T19:12:54.917569+0000 mon.a (mon.0) 602 : cluster [INF] Active manager daemon x restarted 2024-02-22T19:12:55.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:55 smithi063 bash[35391]: cluster 2024-02-22T19:12:54.918160+0000 mon.a (mon.0) 603 : cluster [INF] Activating manager daemon x 2024-02-22T19:12:55.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:55 smithi063 bash[35391]: audit 2024-02-22T19:12:54.918301+0000 mon.b (mon.2) 19 : audit [DBG] from='mgr.? 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T19:12:55.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:55 smithi063 bash[35391]: audit 2024-02-22T19:12:54.918789+0000 mon.b (mon.2) 20 : audit [DBG] from='mgr.? 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:12:55.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:55 smithi063 bash[35391]: cluster 2024-02-22T19:12:54.921130+0000 mon.a (mon.0) 604 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-22T19:12:55.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:55 smithi063 bash[35391]: audit 2024-02-22T19:12:54.921602+0000 mon.b (mon.2) 21 : audit [DBG] from='mgr.? 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T19:12:55.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:55 smithi063 bash[35391]: audit 2024-02-22T19:12:54.921889+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.? 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:12:55.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:55 smithi062 bash[64101]: cluster 2024-02-22T19:12:54.917569+0000 mon.a (mon.0) 602 : cluster [INF] Active manager daemon x restarted 2024-02-22T19:12:55.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:55 smithi062 bash[64101]: cluster 2024-02-22T19:12:54.918160+0000 mon.a (mon.0) 603 : cluster [INF] Activating manager daemon x 2024-02-22T19:12:55.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:55 smithi062 bash[64101]: audit 2024-02-22T19:12:54.918301+0000 mon.b (mon.2) 19 : audit [DBG] from='mgr.? 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T19:12:55.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:55 smithi062 bash[64101]: audit 2024-02-22T19:12:54.918789+0000 mon.b (mon.2) 20 : audit [DBG] from='mgr.? 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:12:55.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:55 smithi062 bash[64101]: cluster 2024-02-22T19:12:54.921130+0000 mon.a (mon.0) 604 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-22T19:12:55.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:55 smithi062 bash[64101]: audit 2024-02-22T19:12:54.921602+0000 mon.b (mon.2) 21 : audit [DBG] from='mgr.? 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T19:12:55.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:55 smithi062 bash[64101]: audit 2024-02-22T19:12:54.921889+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.? 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:12:55.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:55 smithi062 bash[67442]: cluster 2024-02-22T19:12:54.917569+0000 mon.a (mon.0) 602 : cluster [INF] Active manager daemon x restarted 2024-02-22T19:12:55.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:55 smithi062 bash[67442]: cluster 2024-02-22T19:12:54.918160+0000 mon.a (mon.0) 603 : cluster [INF] Activating manager daemon x 2024-02-22T19:12:55.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:55 smithi062 bash[67442]: audit 2024-02-22T19:12:54.918301+0000 mon.b (mon.2) 19 : audit [DBG] from='mgr.? 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T19:12:55.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:55 smithi062 bash[67442]: audit 2024-02-22T19:12:54.918789+0000 mon.b (mon.2) 20 : audit [DBG] from='mgr.? 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:12:55.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:55 smithi062 bash[67442]: cluster 2024-02-22T19:12:54.921130+0000 mon.a (mon.0) 604 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-22T19:12:55.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:55 smithi062 bash[67442]: audit 2024-02-22T19:12:54.921602+0000 mon.b (mon.2) 21 : audit [DBG] from='mgr.? 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T19:12:55.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:55 smithi062 bash[67442]: audit 2024-02-22T19:12:54.921889+0000 mon.b (mon.2) 22 : audit [DBG] from='mgr.? 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:12:56.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:56 smithi063 bash[35391]: cluster 2024-02-22T19:12:55.615457+0000 mon.a (mon.0) 605 : cluster [DBG] mgrmap e16: x(active, starting, since 0.69749s) 2024-02-22T19:12:56.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:56 smithi062 bash[64101]: cluster 2024-02-22T19:12:55.615457+0000 mon.a (mon.0) 605 : cluster [DBG] mgrmap e16: x(active, starting, since 0.69749s) 2024-02-22T19:12:56.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:56 smithi062 bash[67442]: cluster 2024-02-22T19:12:55.615457+0000 mon.a (mon.0) 605 : cluster [DBG] mgrmap e16: x(active, starting, since 0.69749s) 2024-02-22T19:12:58.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:58 smithi063 bash[35391]: cluster 2024-02-22T19:12:57.962365+0000 mon.a (mon.0) 606 : cluster [DBG] Standby manager daemon y started 2024-02-22T19:12:58.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:58 smithi063 bash[35391]: audit 2024-02-22T19:12:57.963267+0000 mon.a (mon.0) 607 : audit [DBG] from='mgr.? 172.21.15.62:0/1127972611' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:12:58.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:58 smithi063 bash[35391]: audit 2024-02-22T19:12:57.964333+0000 mon.a (mon.0) 608 : audit [DBG] from='mgr.? 172.21.15.62:0/1127972611' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:12:58.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:58 smithi062 bash[64101]: cluster 2024-02-22T19:12:57.962365+0000 mon.a (mon.0) 606 : cluster [DBG] Standby manager daemon y started 2024-02-22T19:12:58.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:58 smithi062 bash[64101]: audit 2024-02-22T19:12:57.963267+0000 mon.a (mon.0) 607 : audit [DBG] from='mgr.? 172.21.15.62:0/1127972611' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:12:58.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:58 smithi062 bash[64101]: audit 2024-02-22T19:12:57.964333+0000 mon.a (mon.0) 608 : audit [DBG] from='mgr.? 172.21.15.62:0/1127972611' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:12:58.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:58 smithi062 bash[67442]: cluster 2024-02-22T19:12:57.962365+0000 mon.a (mon.0) 606 : cluster [DBG] Standby manager daemon y started 2024-02-22T19:12:58.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:58 smithi062 bash[67442]: audit 2024-02-22T19:12:57.963267+0000 mon.a (mon.0) 607 : audit [DBG] from='mgr.? 172.21.15.62:0/1127972611' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:12:58.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:58 smithi062 bash[67442]: audit 2024-02-22T19:12:57.964333+0000 mon.a (mon.0) 608 : audit [DBG] from='mgr.? 172.21.15.62:0/1127972611' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:12:59.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:59 smithi063 bash[35391]: cluster 2024-02-22T19:12:58.019198+0000 mon.a (mon.0) 609 : cluster [DBG] mgrmap e17: x(active, starting, since 3s), standbys: y 2024-02-22T19:12:59.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:59 smithi063 bash[35391]: audit 2024-02-22T19:12:58.021564+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.? 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T19:12:59.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:12:59 smithi063 bash[35391]: audit 2024-02-22T19:12:58.021675+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T19:12:59.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:59 smithi062 bash[64101]: cluster 2024-02-22T19:12:58.019198+0000 mon.a (mon.0) 609 : cluster [DBG] mgrmap e17: x(active, starting, since 3s), standbys: y 2024-02-22T19:12:59.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:59 smithi062 bash[64101]: audit 2024-02-22T19:12:58.021564+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.? 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T19:12:59.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:12:59 smithi062 bash[64101]: audit 2024-02-22T19:12:58.021675+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T19:12:59.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:59 smithi062 bash[67442]: cluster 2024-02-22T19:12:58.019198+0000 mon.a (mon.0) 609 : cluster [DBG] mgrmap e17: x(active, starting, since 3s), standbys: y 2024-02-22T19:12:59.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:59 smithi062 bash[67442]: audit 2024-02-22T19:12:58.021564+0000 mon.b (mon.2) 23 : audit [DBG] from='mgr.? 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T19:12:59.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:12:59 smithi062 bash[67442]: audit 2024-02-22T19:12:58.021675+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T19:13:01.963 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[48133]: Warning: Permanently added '172.21.15.62' (ECDSA) to the list of known hosts. 2024-02-22T19:13:01.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.617264+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T19:13:01.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.617434+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T19:13:01.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.617586+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T19:13:01.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.619093+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:13:01.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.619383+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:13:01.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.619635+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:13:01.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.619874+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:13:01.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.620115+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:13:01.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.620326+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:13:01.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.620538+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:13:01.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.620744+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:13:01.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.622319+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T19:13:01.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.622577+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T19:13:01.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.623222+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T19:13:01.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.624144+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T19:13:01.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.625004+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T19:13:01.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.625360+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T19:13:01.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.625706+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi062"}]: dispatch 2024-02-22T19:13:01.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.626054+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi063"}]: dispatch 2024-02-22T19:13:01.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.626397+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T19:13:01.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.626733+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T19:13:01.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.627076+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T19:13:01.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.627406+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T19:13:01.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.627733+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T19:13:01.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.628095+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T19:13:01.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.628415+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T19:13:01.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.628731+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T19:13:01.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.629078+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T19:13:01.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.629396+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-22T19:13:01.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.629707+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T19:13:01.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.630028+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:13:01.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.630353+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:13:01.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.630671+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T19:13:01.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.630999+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T19:13:01.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.631339+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T19:13:01.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.631651+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T19:13:01.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: cluster 2024-02-22T19:13:01.647144+0000 mon.a (mon.0) 610 : cluster [INF] Manager daemon x is now available 2024-02-22T19:13:01.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.660283+0000 mon.b (mon.2) 61 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"172.21.15.62\", \"labels\": [], \"status\": \"\"}, \"smithi063\": {\"hostname\": \"smithi063\", \"addr\": \"smithi063\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-22T19:13:01.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.660923+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"172.21.15.62\", \"labels\": [], \"status\": \"\"}, \"smithi063\": {\"hostname\": \"smithi063\", \"addr\": \"smithi063\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-22T19:13:01.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:01 smithi063 bash[35391]: audit 2024-02-22T19:13:01.664305+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"172.21.15.62\", \"labels\": [], \"status\": \"\"}, \"smithi063\": {\"hostname\": \"smithi063\", \"addr\": \"smithi063\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-22T19:13:01.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.617264+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T19:13:01.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.617434+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T19:13:01.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.617586+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T19:13:01.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.619093+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:13:01.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.619383+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:13:01.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.619635+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:13:01.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.619874+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:13:01.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.620115+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:13:01.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.620326+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:13:01.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.620538+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:13:01.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.620744+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:13:01.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.622319+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T19:13:01.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.622577+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T19:13:01.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.623222+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T19:13:01.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.624144+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T19:13:01.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.625004+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T19:13:01.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.625360+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T19:13:01.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.625706+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi062"}]: dispatch 2024-02-22T19:13:01.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.617264+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T19:13:01.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.617434+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T19:13:01.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.617586+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T19:13:01.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.619093+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:13:01.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.619383+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:13:01.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.619635+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:13:01.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.619874+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:13:01.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.620115+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:13:01.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.620326+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:13:01.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.620538+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:13:01.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.620744+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:13:01.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.622319+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T19:13:01.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.622577+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T19:13:01.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.623222+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T19:13:01.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.624144+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T19:13:01.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.625004+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T19:13:01.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.625360+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T19:13:01.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.625706+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi062"}]: dispatch 2024-02-22T19:13:01.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.626054+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi063"}]: dispatch 2024-02-22T19:13:01.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.626397+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T19:13:01.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.626733+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T19:13:01.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.627076+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T19:13:01.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.627406+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T19:13:01.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.627733+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T19:13:01.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.628095+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T19:13:01.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.628415+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T19:13:01.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.628731+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T19:13:01.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.629078+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T19:13:01.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.629396+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-22T19:13:01.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.629707+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T19:13:01.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.630028+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:13:01.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.630353+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:13:01.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.630671+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T19:13:01.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.630999+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T19:13:01.989 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.631339+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T19:13:01.989 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.631651+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T19:13:01.989 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: cluster 2024-02-22T19:13:01.647144+0000 mon.a (mon.0) 610 : cluster [INF] Manager daemon x is now available 2024-02-22T19:13:01.989 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.660283+0000 mon.b (mon.2) 61 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"172.21.15.62\", \"labels\": [], \"status\": \"\"}, \"smithi063\": {\"hostname\": \"smithi063\", \"addr\": \"smithi063\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-22T19:13:01.989 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.660923+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"172.21.15.62\", \"labels\": [], \"status\": \"\"}, \"smithi063\": {\"hostname\": \"smithi063\", \"addr\": \"smithi063\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-22T19:13:01.989 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[67442]: audit 2024-02-22T19:13:01.664305+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"172.21.15.62\", \"labels\": [], \"status\": \"\"}, \"smithi063\": {\"hostname\": \"smithi063\", \"addr\": \"smithi063\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-22T19:13:01.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.626054+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi063"}]: dispatch 2024-02-22T19:13:01.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.626397+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T19:13:01.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.626733+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T19:13:01.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.627076+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T19:13:01.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.627406+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T19:13:01.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.627733+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T19:13:01.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.628095+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T19:13:01.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.628415+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T19:13:01.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.628731+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T19:13:01.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.629078+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T19:13:01.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.629396+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-22T19:13:01.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.629707+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T19:13:01.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.630028+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:13:01.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.630353+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:13:01.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.630671+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T19:13:01.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.630999+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T19:13:01.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.631339+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T19:13:01.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.631651+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T19:13:01.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: cluster 2024-02-22T19:13:01.647144+0000 mon.a (mon.0) 610 : cluster [INF] Manager daemon x is now available 2024-02-22T19:13:01.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.660283+0000 mon.b (mon.2) 61 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"172.21.15.62\", \"labels\": [], \"status\": \"\"}, \"smithi063\": {\"hostname\": \"smithi063\", \"addr\": \"smithi063\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-22T19:13:01.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.660923+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"172.21.15.62\", \"labels\": [], \"status\": \"\"}, \"smithi063\": {\"hostname\": \"smithi063\", \"addr\": \"smithi063\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-22T19:13:01.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:01 smithi062 bash[64101]: audit 2024-02-22T19:13:01.664305+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"172.21.15.62\", \"labels\": [], \"status\": \"\"}, \"smithi063\": {\"hostname\": \"smithi063\", \"addr\": \"smithi063\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-22T19:13:02.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:02 smithi063 bash[35391]: cephadm 2024-02-22T19:13:01.659784+0000 mgr.x (mgr.34583) 1 : cephadm [INF] inventory: adjusted host smithi062 addr 'smithi062' -> '172.21.15.62' 2024-02-22T19:13:02.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:02 smithi063 bash[35391]: cephadm 2024-02-22T19:13:01.668853+0000 mgr.x (mgr.34583) 2 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-02-22T19:13:02.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:02 smithi063 bash[35391]: audit 2024-02-22T19:13:01.669386+0000 mon.b (mon.2) 62 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-02-22T19:13:02.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:02 smithi063 bash[35391]: audit 2024-02-22T19:13:01.675268+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-02-22T19:13:02.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:02 smithi063 bash[35391]: audit 2024-02-22T19:13:01.680159+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2024-02-22T19:13:02.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:02 smithi063 bash[35391]: cluster 2024-02-22T19:13:01.710441+0000 mon.a (mon.0) 615 : cluster [DBG] mgrmap e18: x(active, since 6s), standbys: y 2024-02-22T19:13:02.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:02 smithi063 bash[35391]: cluster 2024-02-22T19:13:01.714646+0000 mgr.x (mgr.34583) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:02.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:02 smithi063 bash[35391]: audit 2024-02-22T19:13:01.777825+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-02-22T19:13:02.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:02 smithi063 bash[35391]: audit 2024-02-22T19:13:01.778259+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-02-22T19:13:02.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:02 smithi063 bash[35391]: audit 2024-02-22T19:13:01.781993+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]': finished 2024-02-22T19:13:02.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:02 smithi063 bash[35391]: audit 2024-02-22T19:13:01.783277+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:13:02.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:02 smithi063 bash[35391]: audit 2024-02-22T19:13:01.784677+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:13:02.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:02 smithi063 bash[35391]: audit 2024-02-22T19:13:01.817083+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:13:02.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:02 smithi063 bash[35391]: audit 2024-02-22T19:13:01.817658+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:13:02.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:02 smithi063 bash[35391]: audit 2024-02-22T19:13:01.823395+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-22T19:13:02.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:02 smithi063 bash[35391]: audit 2024-02-22T19:13:01.823836+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-22T19:13:02.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[64101]: cephadm 2024-02-22T19:13:01.659784+0000 mgr.x (mgr.34583) 1 : cephadm [INF] inventory: adjusted host smithi062 addr 'smithi062' -> '172.21.15.62' 2024-02-22T19:13:02.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[64101]: cephadm 2024-02-22T19:13:01.668853+0000 mgr.x (mgr.34583) 2 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-02-22T19:13:02.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[64101]: audit 2024-02-22T19:13:01.669386+0000 mon.b (mon.2) 62 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-02-22T19:13:02.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[64101]: audit 2024-02-22T19:13:01.675268+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-02-22T19:13:02.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[64101]: audit 2024-02-22T19:13:01.680159+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2024-02-22T19:13:02.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[64101]: cluster 2024-02-22T19:13:01.710441+0000 mon.a (mon.0) 615 : cluster [DBG] mgrmap e18: x(active, since 6s), standbys: y 2024-02-22T19:13:02.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[64101]: cluster 2024-02-22T19:13:01.714646+0000 mgr.x (mgr.34583) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:02.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[64101]: audit 2024-02-22T19:13:01.777825+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-02-22T19:13:02.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[64101]: audit 2024-02-22T19:13:01.778259+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-02-22T19:13:02.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[64101]: audit 2024-02-22T19:13:01.781993+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]': finished 2024-02-22T19:13:02.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[64101]: audit 2024-02-22T19:13:01.783277+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:13:02.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[64101]: audit 2024-02-22T19:13:01.784677+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:13:02.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[64101]: audit 2024-02-22T19:13:01.817083+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:13:02.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[64101]: audit 2024-02-22T19:13:01.817658+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:13:02.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[64101]: audit 2024-02-22T19:13:01.823395+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-22T19:13:02.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[64101]: audit 2024-02-22T19:13:01.823836+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-22T19:13:02.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[67442]: cephadm 2024-02-22T19:13:01.659784+0000 mgr.x (mgr.34583) 1 : cephadm [INF] inventory: adjusted host smithi062 addr 'smithi062' -> '172.21.15.62' 2024-02-22T19:13:02.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[67442]: cephadm 2024-02-22T19:13:01.668853+0000 mgr.x (mgr.34583) 2 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-02-22T19:13:02.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[67442]: audit 2024-02-22T19:13:01.669386+0000 mon.b (mon.2) 62 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-02-22T19:13:02.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[67442]: audit 2024-02-22T19:13:01.675268+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-02-22T19:13:02.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[67442]: audit 2024-02-22T19:13:01.680159+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2024-02-22T19:13:02.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[67442]: cluster 2024-02-22T19:13:01.710441+0000 mon.a (mon.0) 615 : cluster [DBG] mgrmap e18: x(active, since 6s), standbys: y 2024-02-22T19:13:02.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[67442]: cluster 2024-02-22T19:13:01.714646+0000 mgr.x (mgr.34583) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:02.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[67442]: audit 2024-02-22T19:13:01.777825+0000 mon.b (mon.2) 63 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-02-22T19:13:02.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[67442]: audit 2024-02-22T19:13:01.778259+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-02-22T19:13:02.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[67442]: audit 2024-02-22T19:13:01.781993+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]': finished 2024-02-22T19:13:02.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[67442]: audit 2024-02-22T19:13:01.783277+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:13:02.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[67442]: audit 2024-02-22T19:13:01.784677+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:13:02.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[67442]: audit 2024-02-22T19:13:01.817083+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:13:02.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[67442]: audit 2024-02-22T19:13:01.817658+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:13:02.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[67442]: audit 2024-02-22T19:13:01.823395+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-22T19:13:02.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:02 smithi062 bash[67442]: audit 2024-02-22T19:13:01.823836+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-22T19:13:04.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:04 smithi062 bash[64101]: cluster 2024-02-22T19:13:03.622502+0000 mgr.x (mgr.34583) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:04.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:04 smithi062 bash[64101]: cluster 2024-02-22T19:13:03.715428+0000 mon.a (mon.0) 620 : cluster [DBG] mgrmap e19: x(active, since 8s), standbys: y 2024-02-22T19:13:04.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:04 smithi062 bash[67442]: cluster 2024-02-22T19:13:03.622502+0000 mgr.x (mgr.34583) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:04.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:04 smithi062 bash[67442]: cluster 2024-02-22T19:13:03.715428+0000 mon.a (mon.0) 620 : cluster [DBG] mgrmap e19: x(active, since 8s), standbys: y 2024-02-22T19:13:05.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:04 smithi063 bash[35391]: cluster 2024-02-22T19:13:03.622502+0000 mgr.x (mgr.34583) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:05.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:04 smithi063 bash[35391]: cluster 2024-02-22T19:13:03.715428+0000 mon.a (mon.0) 620 : cluster [DBG] mgrmap e19: x(active, since 8s), standbys: y 2024-02-22T19:13:06.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:06 smithi063 bash[35391]: cluster 2024-02-22T19:13:05.623002+0000 mgr.x (mgr.34583) 5 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:06.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:06 smithi062 bash[64101]: cluster 2024-02-22T19:13:05.623002+0000 mgr.x (mgr.34583) 5 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:06.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:06 smithi062 bash[67442]: cluster 2024-02-22T19:13:05.623002+0000 mgr.x (mgr.34583) 5 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:08.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:08 smithi063 bash[35391]: cluster 2024-02-22T19:13:07.623868+0000 mgr.x (mgr.34583) 6 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:08.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:08 smithi062 bash[64101]: cluster 2024-02-22T19:13:07.623868+0000 mgr.x (mgr.34583) 6 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:08.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:08 smithi062 bash[67442]: cluster 2024-02-22T19:13:07.623868+0000 mgr.x (mgr.34583) 6 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:10.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:10 smithi063 bash[35391]: cluster 2024-02-22T19:13:09.624401+0000 mgr.x (mgr.34583) 7 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:10.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:10 smithi062 bash[64101]: cluster 2024-02-22T19:13:09.624401+0000 mgr.x (mgr.34583) 7 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:10.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:10 smithi062 bash[67442]: cluster 2024-02-22T19:13:09.624401+0000 mgr.x (mgr.34583) 7 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:12.092 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-02-22T19:13:12.731 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T19:13:12.731 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.a smithi062 running (4m) 3m ago 5m - - 9f27df16978d 898c40402160 2024-02-22T19:13:12.731 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.a smithi063 running (4m) 19s ago 4m - - 6.6.2 87a51ecf0b1c 9863e2980fa6 2024-02-22T19:13:12.731 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.x smithi063 running (24s) 19s ago 8m - - 16.2.14-550-geb66ed92 7403d1862307 c7743467a258 2024-02-22T19:13:12.731 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.y smithi062 running (10m) 3m ago 10m - - 15.2.0 204a01f9b0b6 5a701a128b9c 2024-02-22T19:13:12.731 INFO:teuthology.orchestra.run.smithi062.stdout:mon.a smithi062 running (10m) 3m ago 10m - 2048M 15.2.0 204a01f9b0b6 edca537a955b 2024-02-22T19:13:12.731 INFO:teuthology.orchestra.run.smithi062.stdout:mon.b smithi063 running (8m) 19s ago 8m - 2048M 15.2.0 204a01f9b0b6 deb740d884ca 2024-02-22T19:13:12.731 INFO:teuthology.orchestra.run.smithi062.stdout:mon.c smithi062 running (8m) 3m ago 8m - 2048M 15.2.0 204a01f9b0b6 921b06886416 2024-02-22T19:13:12.731 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.a smithi062 running (5m) 3m ago 5m - - 72c9c2088986 3e27c560bf7f 2024-02-22T19:13:12.731 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.b smithi063 running (5m) 19s ago 5m - - 72c9c2088986 ab2867e3fd57 2024-02-22T19:13:12.731 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (8m) 3m ago 8m - 4096M 15.2.0 204a01f9b0b6 e651beecc87d 2024-02-22T19:13:12.732 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (7m) 3m ago 7m - 4096M 15.2.0 204a01f9b0b6 d7a667155c4b 2024-02-22T19:13:12.732 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (7m) 3m ago 7m - 4096M 15.2.0 204a01f9b0b6 dc5ec198f96d 2024-02-22T19:13:12.732 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi062 running (7m) 3m ago 7m - 4096M 15.2.0 204a01f9b0b6 efb44063d52f 2024-02-22T19:13:12.732 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi063 running (6m) 19s ago 6m - 4096M 15.2.0 204a01f9b0b6 0affbe803c22 2024-02-22T19:13:12.732 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi063 running (6m) 19s ago 6m - 4096M 15.2.0 204a01f9b0b6 636665ed6108 2024-02-22T19:13:12.732 INFO:teuthology.orchestra.run.smithi062.stdout:osd.6 smithi063 running (6m) 19s ago 6m - 4096M 15.2.0 204a01f9b0b6 8c48e05bc7dd 2024-02-22T19:13:12.732 INFO:teuthology.orchestra.run.smithi062.stdout:osd.7 smithi063 running (5m) 19s ago 5m - 4096M 15.2.0 204a01f9b0b6 c298ad18c8bb 2024-02-22T19:13:12.732 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.a smithi063 running (4m) 19s ago 5m - - 38c53d8da784 df5dba6a5dc9 2024-02-22T19:13:12.732 INFO:teuthology.orchestra.run.smithi062.stdout:rgw.r.z.smithi062.zxmpna smithi062 running (3m) 3m ago 3m - - 15.2.0 204a01f9b0b6 45553891c2c4 2024-02-22T19:13:12.732 INFO:teuthology.orchestra.run.smithi062.stdout:rgw.r.z.smithi063.feyald smithi063 running (3m) 19s ago 3m - - 15.2.0 204a01f9b0b6 478364f15ee3 2024-02-22T19:13:12.963 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:13:12 smithi063 bash[48133]: Warning: Permanently added 'smithi063,172.21.15.63' (ECDSA) to the list of known hosts. 2024-02-22T19:13:12.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:12 smithi063 bash[35391]: cluster 2024-02-22T19:13:11.624923+0000 mgr.x (mgr.34583) 8 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:12.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:12 smithi063 bash[35391]: audit 2024-02-22T19:13:12.079869+0000 mgr.x (mgr.34583) 9 : audit [DBG] from='client.24751 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:12.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:12 smithi063 bash[35391]: audit 2024-02-22T19:13:12.516734+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]: dispatch 2024-02-22T19:13:12.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:12 smithi063 bash[35391]: audit 2024-02-22T19:13:12.517169+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]: dispatch 2024-02-22T19:13:12.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:12 smithi063 bash[35391]: audit 2024-02-22T19:13:12.521205+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]': finished 2024-02-22T19:13:12.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:12 smithi063 bash[35391]: audit 2024-02-22T19:13:12.523925+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr.x"}]: dispatch 2024-02-22T19:13:12.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:12 smithi063 bash[35391]: audit 2024-02-22T19:13:12.524327+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr.x"}]: dispatch 2024-02-22T19:13:12.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:12 smithi063 bash[35391]: audit 2024-02-22T19:13:12.527685+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr.x"}]': finished 2024-02-22T19:13:12.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:12 smithi063 bash[35391]: audit 2024-02-22T19:13:12.531332+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:13:12.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:12 smithi062 bash[67442]: cluster 2024-02-22T19:13:11.624923+0000 mgr.x (mgr.34583) 8 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:12.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:12 smithi062 bash[67442]: audit 2024-02-22T19:13:12.079869+0000 mgr.x (mgr.34583) 9 : audit [DBG] from='client.24751 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:12.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:12 smithi062 bash[67442]: audit 2024-02-22T19:13:12.516734+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]: dispatch 2024-02-22T19:13:12.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:12 smithi062 bash[67442]: audit 2024-02-22T19:13:12.517169+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]: dispatch 2024-02-22T19:13:12.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:12 smithi062 bash[67442]: audit 2024-02-22T19:13:12.521205+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]': finished 2024-02-22T19:13:12.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:12 smithi062 bash[67442]: audit 2024-02-22T19:13:12.523925+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr.x"}]: dispatch 2024-02-22T19:13:12.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:12 smithi062 bash[67442]: audit 2024-02-22T19:13:12.524327+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr.x"}]: dispatch 2024-02-22T19:13:12.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:12 smithi062 bash[67442]: audit 2024-02-22T19:13:12.527685+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr.x"}]': finished 2024-02-22T19:13:12.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:12 smithi062 bash[67442]: audit 2024-02-22T19:13:12.531332+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:13:12.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:12 smithi062 bash[64101]: cluster 2024-02-22T19:13:11.624923+0000 mgr.x (mgr.34583) 8 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:12.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:12 smithi062 bash[64101]: audit 2024-02-22T19:13:12.079869+0000 mgr.x (mgr.34583) 9 : audit [DBG] from='client.24751 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:12.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:12 smithi062 bash[64101]: audit 2024-02-22T19:13:12.516734+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]: dispatch 2024-02-22T19:13:12.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:12 smithi062 bash[64101]: audit 2024-02-22T19:13:12.517169+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]: dispatch 2024-02-22T19:13:12.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:12 smithi062 bash[64101]: audit 2024-02-22T19:13:12.521205+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]': finished 2024-02-22T19:13:12.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:12 smithi062 bash[64101]: audit 2024-02-22T19:13:12.523925+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr.x"}]: dispatch 2024-02-22T19:13:12.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:12 smithi062 bash[64101]: audit 2024-02-22T19:13:12.524327+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr.x"}]: dispatch 2024-02-22T19:13:12.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:12 smithi062 bash[64101]: audit 2024-02-22T19:13:12.527685+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr.x"}]': finished 2024-02-22T19:13:12.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:12 smithi062 bash[64101]: audit 2024-02-22T19:13:12.531332+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:13:13.170 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-22T19:13:13.170 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-02-22T19:13:13.170 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-22T19:13:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:13:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-02-22T19:13:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2024-02-22T19:13:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 1 2024-02-22T19:13:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:13:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-02-22T19:13:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-22T19:13:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:13:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": {}, 2024-02-22T19:13:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw": { 2024-02-22T19:13:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-22T19:13:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:13:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-02-22T19:13:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 14, 2024-02-22T19:13:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 1 2024-02-22T19:13:13.171 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-02-22T19:13:13.171 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-22T19:13:13.500 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-22T19:13:13.500 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59", 2024-02-22T19:13:13.500 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-02-22T19:13:13.500 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T19:13:13.500 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [], 2024-02-22T19:13:13.500 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "", 2024-02-22T19:13:13.500 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "", 2024-02-22T19:13:13.501 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-02-22T19:13:13.501 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-22T19:13:13.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[67442]: audit 2024-02-22T19:13:12.400058+0000 mgr.x (mgr.34583) 10 : audit [DBG] from='client.24757 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:13.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[67442]: audit 2024-02-22T19:13:12.718405+0000 mgr.x (mgr.34583) 11 : audit [DBG] from='client.24763 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:13.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[67442]: audit 2024-02-22T19:13:12.720968+0000 mon.b (mon.2) 71 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:13:13.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[67442]: audit 2024-02-22T19:13:12.721374+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:13:13.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[67442]: audit 2024-02-22T19:13:12.721695+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[67442]: audit 2024-02-22T19:13:12.722020+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[67442]: audit 2024-02-22T19:13:12.722351+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[67442]: audit 2024-02-22T19:13:12.722639+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[67442]: audit 2024-02-22T19:13:12.724396+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:13:13.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[67442]: audit 2024-02-22T19:13:12.724690+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[67442]: audit 2024-02-22T19:13:12.724980+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[67442]: audit 2024-02-22T19:13:12.725244+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[67442]: audit 2024-02-22T19:13:12.725508+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[67442]: audit 2024-02-22T19:13:12.805548+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:13:13.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[67442]: audit 2024-02-22T19:13:13.170537+0000 mon.b (mon.2) 83 : audit [DBG] from='client.? 172.21.15.62:0/845900780' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:13:13.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[64101]: audit 2024-02-22T19:13:12.400058+0000 mgr.x (mgr.34583) 10 : audit [DBG] from='client.24757 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:13.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[64101]: audit 2024-02-22T19:13:12.718405+0000 mgr.x (mgr.34583) 11 : audit [DBG] from='client.24763 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:13.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[64101]: audit 2024-02-22T19:13:12.720968+0000 mon.b (mon.2) 71 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:13:13.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[64101]: audit 2024-02-22T19:13:12.721374+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:13:13.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[64101]: audit 2024-02-22T19:13:12.721695+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[64101]: audit 2024-02-22T19:13:12.722020+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[64101]: audit 2024-02-22T19:13:12.722351+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[64101]: audit 2024-02-22T19:13:12.722639+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[64101]: audit 2024-02-22T19:13:12.724396+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:13:13.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[64101]: audit 2024-02-22T19:13:12.724690+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[64101]: audit 2024-02-22T19:13:12.724980+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[64101]: audit 2024-02-22T19:13:12.725244+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[64101]: audit 2024-02-22T19:13:12.725508+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[64101]: audit 2024-02-22T19:13:12.805548+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:13:13.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:13 smithi062 bash[64101]: audit 2024-02-22T19:13:13.170537+0000 mon.b (mon.2) 83 : audit [DBG] from='client.? 172.21.15.62:0/845900780' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:13:13.906 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:13 smithi063 bash[35391]: audit 2024-02-22T19:13:12.400058+0000 mgr.x (mgr.34583) 10 : audit [DBG] from='client.24757 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:13.906 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:13 smithi063 bash[35391]: audit 2024-02-22T19:13:12.718405+0000 mgr.x (mgr.34583) 11 : audit [DBG] from='client.24763 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:13.906 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:13 smithi063 bash[35391]: audit 2024-02-22T19:13:12.720968+0000 mon.b (mon.2) 71 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:13:13.906 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:13 smithi063 bash[35391]: audit 2024-02-22T19:13:12.721374+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:13:13.906 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:13 smithi063 bash[35391]: audit 2024-02-22T19:13:12.721695+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.906 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:13 smithi063 bash[35391]: audit 2024-02-22T19:13:12.722020+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.906 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:13 smithi063 bash[35391]: audit 2024-02-22T19:13:12.722351+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.906 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:13 smithi063 bash[35391]: audit 2024-02-22T19:13:12.722639+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.906 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:13 smithi063 bash[35391]: audit 2024-02-22T19:13:12.724396+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:13:13.906 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:13 smithi063 bash[35391]: audit 2024-02-22T19:13:12.724690+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.906 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:13 smithi063 bash[35391]: audit 2024-02-22T19:13:12.724980+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.906 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:13 smithi063 bash[35391]: audit 2024-02-22T19:13:12.725244+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.906 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:13 smithi063 bash[35391]: audit 2024-02-22T19:13:12.725508+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:13.907 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:13 smithi063 bash[35391]: audit 2024-02-22T19:13:12.805548+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:13:13.907 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:13 smithi063 bash[35391]: audit 2024-02-22T19:13:13.170537+0000 mon.b (mon.2) 83 : audit [DBG] from='client.? 172.21.15.62:0/845900780' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:13:14.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:14 smithi063 bash[35391]: audit 2024-02-22T19:13:13.499918+0000 mgr.x (mgr.34583) 12 : audit [DBG] from='client.24775 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:14.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:14 smithi063 bash[35391]: cluster 2024-02-22T19:13:13.625645+0000 mgr.x (mgr.34583) 13 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:14.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:14 smithi062 bash[64101]: audit 2024-02-22T19:13:13.499918+0000 mgr.x (mgr.34583) 12 : audit [DBG] from='client.24775 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:14.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:14 smithi062 bash[64101]: cluster 2024-02-22T19:13:13.625645+0000 mgr.x (mgr.34583) 13 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:14.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:14 smithi062 bash[67442]: audit 2024-02-22T19:13:13.499918+0000 mgr.x (mgr.34583) 12 : audit [DBG] from='client.24775 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:14.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:14 smithi062 bash[67442]: cluster 2024-02-22T19:13:13.625645+0000 mgr.x (mgr.34583) 13 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:16.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:16 smithi063 bash[35391]: cluster 2024-02-22T19:13:15.626080+0000 mgr.x (mgr.34583) 14 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:16.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:16 smithi063 bash[35391]: audit 2024-02-22T19:13:16.550984+0000 mon.b (mon.2) 84 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:16.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:16 smithi063 bash[35391]: audit 2024-02-22T19:13:16.551705+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:16.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:16 smithi062 bash[64101]: cluster 2024-02-22T19:13:15.626080+0000 mgr.x (mgr.34583) 14 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:16.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:16 smithi062 bash[67442]: cluster 2024-02-22T19:13:15.626080+0000 mgr.x (mgr.34583) 14 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:16.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:16 smithi062 bash[64101]: audit 2024-02-22T19:13:16.550984+0000 mon.b (mon.2) 84 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:16.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:16 smithi062 bash[64101]: audit 2024-02-22T19:13:16.551705+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:16.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:16 smithi062 bash[67442]: audit 2024-02-22T19:13:16.550984+0000 mon.b (mon.2) 84 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:16.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:16 smithi062 bash[67442]: audit 2024-02-22T19:13:16.551705+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:17.852 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:17 smithi063 bash[35391]: audit 2024-02-22T19:13:16.554536+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:13:17.852 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:17 smithi063 bash[35391]: audit 2024-02-22T19:13:16.870468+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:17.853 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:17 smithi063 bash[35391]: audit 2024-02-22T19:13:16.870838+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:17.853 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:17 smithi063 bash[35391]: audit 2024-02-22T19:13:16.871143+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:17.853 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:17 smithi063 bash[35391]: audit 2024-02-22T19:13:16.871412+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:17.853 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:17 smithi063 bash[35391]: audit 2024-02-22T19:13:16.871691+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:17.853 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:17 smithi063 bash[35391]: audit 2024-02-22T19:13:16.871969+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:17.853 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:17 smithi063 bash[35391]: audit 2024-02-22T19:13:16.872236+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:17.853 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:17 smithi063 bash[35391]: audit 2024-02-22T19:13:16.872507+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:17.853 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:17 smithi063 bash[35391]: audit 2024-02-22T19:13:16.872782+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:17.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:17 smithi062 bash[64101]: audit 2024-02-22T19:13:16.554536+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:13:17.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:17 smithi062 bash[64101]: audit 2024-02-22T19:13:16.870468+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:17.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:17 smithi062 bash[64101]: audit 2024-02-22T19:13:16.870838+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:17.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:17 smithi062 bash[64101]: audit 2024-02-22T19:13:16.871143+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:17.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:17 smithi062 bash[64101]: audit 2024-02-22T19:13:16.871412+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:17.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:17 smithi062 bash[64101]: audit 2024-02-22T19:13:16.871691+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:17.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:17 smithi062 bash[64101]: audit 2024-02-22T19:13:16.871969+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:17.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:17 smithi062 bash[64101]: audit 2024-02-22T19:13:16.872236+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:17.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:17 smithi062 bash[64101]: audit 2024-02-22T19:13:16.872507+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:17.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:17 smithi062 bash[64101]: audit 2024-02-22T19:13:16.872782+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:17.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:17 smithi062 bash[67442]: audit 2024-02-22T19:13:16.554536+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:13:17.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:17 smithi062 bash[67442]: audit 2024-02-22T19:13:16.870468+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:17.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:17 smithi062 bash[67442]: audit 2024-02-22T19:13:16.870838+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:17.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:17 smithi062 bash[67442]: audit 2024-02-22T19:13:16.871143+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:17.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:17 smithi062 bash[67442]: audit 2024-02-22T19:13:16.871412+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:17.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:17 smithi062 bash[67442]: audit 2024-02-22T19:13:16.871691+0000 mon.b (mon.2) 89 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:17.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:17 smithi062 bash[67442]: audit 2024-02-22T19:13:16.871969+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:17.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:17 smithi062 bash[67442]: audit 2024-02-22T19:13:16.872236+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:17.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:17 smithi062 bash[67442]: audit 2024-02-22T19:13:16.872507+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:17.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:17 smithi062 bash[67442]: audit 2024-02-22T19:13:16.872782+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:18.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:18 smithi063 bash[35391]: cluster 2024-02-22T19:13:17.626713+0000 mgr.x (mgr.34583) 15 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:18.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:18 smithi063 bash[35391]: audit 2024-02-22T19:13:18.203205+0000 mon.b (mon.2) 94 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 30219960, \"cpu_percentage\": \"0.23%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201804Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:08:50.304019Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:18.202109Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:18.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:18 smithi063 bash[35391]: audit 2024-02-22T19:13:18.203968+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 30219960, \"cpu_percentage\": \"0.23%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201804Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:08:50.304019Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:18.202109Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:18.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:18 smithi063 bash[35391]: audit 2024-02-22T19:13:18.208614+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 30219960, \"cpu_percentage\": \"0.23%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201804Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:08:50.304019Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:18.202109Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:13:18.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:18 smithi063 bash[35391]: audit 2024-02-22T19:13:18.518231+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:18.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:18 smithi063 bash[35391]: audit 2024-02-22T19:13:18.518590+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:18.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:18 smithi063 bash[35391]: audit 2024-02-22T19:13:18.518874+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:18.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:18 smithi063 bash[35391]: audit 2024-02-22T19:13:18.519146+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:18.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:18 smithi063 bash[35391]: audit 2024-02-22T19:13:18.519405+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:18.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:18 smithi063 bash[35391]: audit 2024-02-22T19:13:18.519648+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:18.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:18 smithi063 bash[35391]: audit 2024-02-22T19:13:18.519886+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:18.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:18 smithi063 bash[35391]: audit 2024-02-22T19:13:18.520149+0000 mon.b (mon.2) 102 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:18.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:18 smithi063 bash[35391]: audit 2024-02-22T19:13:18.520412+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:18.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:18 smithi063 bash[35391]: audit 2024-02-22T19:13:18.521573+0000 mon.b (mon.2) 104 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:13:18.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:18 smithi063 bash[35391]: audit 2024-02-22T19:13:18.521958+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:13:18.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:18 smithi063 bash[35391]: audit 2024-02-22T19:13:18.526071+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-22T19:13:18.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:18 smithi063 bash[35391]: audit 2024-02-22T19:13:18.529243+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:13:18.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:18 smithi063 bash[35391]: audit 2024-02-22T19:13:18.529789+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:13:18.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:18 smithi063 bash[35391]: audit 2024-02-22T19:13:18.530315+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:13:18.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:18 smithi063 bash[35391]: audit 2024-02-22T19:13:18.531093+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-22T19:13:18.960 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[64101]: cluster 2024-02-22T19:13:17.626713+0000 mgr.x (mgr.34583) 15 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:18.960 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[64101]: audit 2024-02-22T19:13:18.203205+0000 mon.b (mon.2) 94 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 30219960, \"cpu_percentage\": \"0.23%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201804Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:08:50.304019Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:18.202109Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:18.960 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[64101]: audit 2024-02-22T19:13:18.203968+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 30219960, \"cpu_percentage\": \"0.23%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201804Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:08:50.304019Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:18.202109Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:18.961 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[64101]: audit 2024-02-22T19:13:18.208614+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 30219960, \"cpu_percentage\": \"0.23%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201804Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:08:50.304019Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:18.202109Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:13:18.961 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[64101]: audit 2024-02-22T19:13:18.518231+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:18.961 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[64101]: audit 2024-02-22T19:13:18.518590+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:18.961 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[64101]: audit 2024-02-22T19:13:18.518874+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:18.961 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[64101]: audit 2024-02-22T19:13:18.519146+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:18.961 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[64101]: audit 2024-02-22T19:13:18.519405+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:18.961 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[64101]: audit 2024-02-22T19:13:18.519648+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:18.961 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[64101]: audit 2024-02-22T19:13:18.519886+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:18.961 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[64101]: audit 2024-02-22T19:13:18.520149+0000 mon.b (mon.2) 102 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:18.961 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[64101]: audit 2024-02-22T19:13:18.520412+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:18.961 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[64101]: audit 2024-02-22T19:13:18.521573+0000 mon.b (mon.2) 104 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:13:18.961 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[64101]: audit 2024-02-22T19:13:18.521958+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:13:18.962 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[67442]: cluster 2024-02-22T19:13:17.626713+0000 mgr.x (mgr.34583) 15 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:18.962 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[64101]: audit 2024-02-22T19:13:18.526071+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-22T19:13:18.962 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[64101]: audit 2024-02-22T19:13:18.529243+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:13:18.962 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[64101]: audit 2024-02-22T19:13:18.529789+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:13:18.962 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[64101]: audit 2024-02-22T19:13:18.530315+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:13:18.962 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[64101]: audit 2024-02-22T19:13:18.531093+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-22T19:13:18.963 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[67442]: audit 2024-02-22T19:13:18.203205+0000 mon.b (mon.2) 94 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 30219960, \"cpu_percentage\": \"0.23%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201804Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:08:50.304019Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:18.202109Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:18.963 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[67442]: audit 2024-02-22T19:13:18.203968+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 30219960, \"cpu_percentage\": \"0.23%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201804Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:08:50.304019Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:18.202109Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:18.963 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[67442]: audit 2024-02-22T19:13:18.208614+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 30219960, \"cpu_percentage\": \"0.23%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201804Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:08:50.304019Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:23.138714Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:18.202109Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:13:18.963 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[67442]: audit 2024-02-22T19:13:18.518231+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:18.963 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[67442]: audit 2024-02-22T19:13:18.518590+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:18.963 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[67442]: audit 2024-02-22T19:13:18.518874+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:18.963 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[67442]: audit 2024-02-22T19:13:18.519146+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:18.963 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[67442]: audit 2024-02-22T19:13:18.519405+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:18.964 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[67442]: audit 2024-02-22T19:13:18.519648+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:18.964 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[67442]: audit 2024-02-22T19:13:18.519886+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:18.964 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[67442]: audit 2024-02-22T19:13:18.520149+0000 mon.b (mon.2) 102 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:18.964 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[67442]: audit 2024-02-22T19:13:18.520412+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:13:18.964 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[67442]: audit 2024-02-22T19:13:18.521573+0000 mon.b (mon.2) 104 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:13:18.964 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[67442]: audit 2024-02-22T19:13:18.521958+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:13:18.964 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[67442]: audit 2024-02-22T19:13:18.526071+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-22T19:13:18.964 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[67442]: audit 2024-02-22T19:13:18.529243+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:13:18.964 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[67442]: audit 2024-02-22T19:13:18.529789+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:13:18.964 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[67442]: audit 2024-02-22T19:13:18.530315+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:13:18.964 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:18 smithi062 bash[67442]: audit 2024-02-22T19:13:18.531093+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-22T19:13:19.937 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:19 smithi062 bash[64101]: cephadm 2024-02-22T19:13:18.528979+0000 mgr.x (mgr.34583) 16 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-02-22T19:13:19.937 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:19 smithi062 bash[64101]: cephadm 2024-02-22T19:13:18.530794+0000 mgr.x (mgr.34583) 17 : cephadm [INF] Reconfiguring daemon mon.a on smithi062 2024-02-22T19:13:19.938 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:19 smithi062 bash[67442]: cephadm 2024-02-22T19:13:18.528979+0000 mgr.x (mgr.34583) 16 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-02-22T19:13:19.938 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:19 smithi062 bash[67442]: cephadm 2024-02-22T19:13:18.530794+0000 mgr.x (mgr.34583) 17 : cephadm [INF] Reconfiguring daemon mon.a on smithi062 2024-02-22T19:13:19.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:19 smithi063 bash[35391]: cephadm 2024-02-22T19:13:18.528979+0000 mgr.x (mgr.34583) 16 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-02-22T19:13:19.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:19 smithi063 bash[35391]: cephadm 2024-02-22T19:13:18.530794+0000 mgr.x (mgr.34583) 17 : cephadm [INF] Reconfiguring daemon mon.a on smithi062 2024-02-22T19:13:20.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:20 smithi062 bash[64101]: cluster 2024-02-22T19:13:19.627276+0000 mgr.x (mgr.34583) 18 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:20.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:20 smithi062 bash[67442]: cluster 2024-02-22T19:13:19.627276+0000 mgr.x (mgr.34583) 18 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:20.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:20 smithi062 bash[64101]: audit 2024-02-22T19:13:19.980985+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:20.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:20 smithi062 bash[67442]: audit 2024-02-22T19:13:19.980985+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:20.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:20 smithi062 bash[64101]: audit 2024-02-22T19:13:19.981768+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:20.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:20 smithi062 bash[64101]: audit 2024-02-22T19:13:19.984833+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:13:20.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:20 smithi062 bash[64101]: cephadm 2024-02-22T19:13:19.988022+0000 mgr.x (mgr.34583) 19 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-22T19:13:20.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:20 smithi062 bash[64101]: audit 2024-02-22T19:13:19.988350+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:13:20.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:20 smithi062 bash[64101]: audit 2024-02-22T19:13:19.989145+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:13:20.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:20 smithi062 bash[64101]: audit 2024-02-22T19:13:19.989846+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:13:20.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:20 smithi062 bash[64101]: cephadm 2024-02-22T19:13:19.990476+0000 mgr.x (mgr.34583) 20 : cephadm [INF] Reconfiguring daemon mon.c on smithi062 2024-02-22T19:13:20.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:20 smithi062 bash[64101]: audit 2024-02-22T19:13:19.990908+0000 mon.b (mon.2) 113 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-22T19:13:20.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:20 smithi062 bash[67442]: audit 2024-02-22T19:13:19.981768+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:20.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:20 smithi062 bash[67442]: audit 2024-02-22T19:13:19.984833+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:13:20.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:20 smithi062 bash[67442]: cephadm 2024-02-22T19:13:19.988022+0000 mgr.x (mgr.34583) 19 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-22T19:13:20.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:20 smithi062 bash[67442]: audit 2024-02-22T19:13:19.988350+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:13:20.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:20 smithi062 bash[67442]: audit 2024-02-22T19:13:19.989145+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:13:20.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:20 smithi062 bash[67442]: audit 2024-02-22T19:13:19.989846+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:13:20.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:20 smithi062 bash[67442]: cephadm 2024-02-22T19:13:19.990476+0000 mgr.x (mgr.34583) 20 : cephadm [INF] Reconfiguring daemon mon.c on smithi062 2024-02-22T19:13:20.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:20 smithi062 bash[67442]: audit 2024-02-22T19:13:19.990908+0000 mon.b (mon.2) 113 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-22T19:13:20.865 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:20 smithi063 bash[35391]: cluster 2024-02-22T19:13:19.627276+0000 mgr.x (mgr.34583) 18 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:20.866 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:20 smithi063 bash[35391]: audit 2024-02-22T19:13:19.980985+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:20.866 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:20 smithi063 bash[35391]: audit 2024-02-22T19:13:19.981768+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:20.866 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:20 smithi063 bash[35391]: audit 2024-02-22T19:13:19.984833+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:10.472860Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:13:20.866 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:20 smithi063 bash[35391]: cephadm 2024-02-22T19:13:19.988022+0000 mgr.x (mgr.34583) 19 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-22T19:13:20.866 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:20 smithi063 bash[35391]: audit 2024-02-22T19:13:19.988350+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:13:20.866 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:20 smithi063 bash[35391]: audit 2024-02-22T19:13:19.989145+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:13:20.866 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:20 smithi063 bash[35391]: audit 2024-02-22T19:13:19.989846+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:13:20.866 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:20 smithi063 bash[35391]: cephadm 2024-02-22T19:13:19.990476+0000 mgr.x (mgr.34583) 20 : cephadm [INF] Reconfiguring daemon mon.c on smithi062 2024-02-22T19:13:20.866 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:20 smithi063 bash[35391]: audit 2024-02-22T19:13:19.990908+0000 mon.b (mon.2) 113 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-22T19:13:21.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:21 smithi062 bash[64101]: audit 2024-02-22T19:13:21.447144+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:21.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:21 smithi062 bash[67442]: audit 2024-02-22T19:13:21.447144+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:21.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:21 smithi062 bash[64101]: audit 2024-02-22T19:13:21.448042+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:21.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:21 smithi062 bash[64101]: audit 2024-02-22T19:13:21.452040+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:13:21.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:21 smithi062 bash[67442]: audit 2024-02-22T19:13:21.448042+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:21.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:21 smithi062 bash[67442]: audit 2024-02-22T19:13:21.452040+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:13:21.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:21 smithi063 bash[35391]: audit 2024-02-22T19:13:21.447144+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:21.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:21 smithi063 bash[35391]: audit 2024-02-22T19:13:21.448042+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:21.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:21 smithi063 bash[35391]: audit 2024-02-22T19:13:21.452040+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"898c40402160\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 27000832, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549640Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:08:46.427160Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-22T19:08:39.652649Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:16.549817Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:13:22.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:22 smithi063 bash[35391]: cephadm 2024-02-22T19:13:21.453666+0000 mgr.x (mgr.34583) 21 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-22T19:13:22.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:22 smithi063 bash[35391]: cephadm 2024-02-22T19:13:21.465203+0000 mgr.x (mgr.34583) 22 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi062 2024-02-22T19:13:22.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:22 smithi063 bash[35391]: cluster 2024-02-22T19:13:21.627770+0000 mgr.x (mgr.34583) 23 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:22.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:22 smithi062 bash[64101]: cephadm 2024-02-22T19:13:21.453666+0000 mgr.x (mgr.34583) 21 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-22T19:13:22.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:22 smithi062 bash[64101]: cephadm 2024-02-22T19:13:21.465203+0000 mgr.x (mgr.34583) 22 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi062 2024-02-22T19:13:22.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:22 smithi062 bash[64101]: cluster 2024-02-22T19:13:21.627770+0000 mgr.x (mgr.34583) 23 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:22.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:22 smithi062 bash[67442]: cephadm 2024-02-22T19:13:21.453666+0000 mgr.x (mgr.34583) 21 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-22T19:13:22.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:22 smithi062 bash[67442]: cephadm 2024-02-22T19:13:21.465203+0000 mgr.x (mgr.34583) 22 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi062 2024-02-22T19:13:22.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:22 smithi062 bash[67442]: cluster 2024-02-22T19:13:21.627770+0000 mgr.x (mgr.34583) 23 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:24.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:24 smithi063 bash[35391]: cluster 2024-02-22T19:13:23.628579+0000 mgr.x (mgr.34583) 24 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:24.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:24 smithi062 bash[64101]: cluster 2024-02-22T19:13:23.628579+0000 mgr.x (mgr.34583) 24 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:24.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:24 smithi062 bash[67442]: cluster 2024-02-22T19:13:23.628579+0000 mgr.x (mgr.34583) 24 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:26.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:26 smithi062 bash[64101]: cluster 2024-02-22T19:13:25.629140+0000 mgr.x (mgr.34583) 25 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:26.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:26 smithi062 bash[67442]: cluster 2024-02-22T19:13:25.629140+0000 mgr.x (mgr.34583) 25 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:26.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:26 smithi063 bash[35391]: cluster 2024-02-22T19:13:25.629140+0000 mgr.x (mgr.34583) 25 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:28.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:28 smithi063 bash[35391]: cluster 2024-02-22T19:13:27.629910+0000 mgr.x (mgr.34583) 26 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:28.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:28 smithi062 bash[64101]: cluster 2024-02-22T19:13:27.629910+0000 mgr.x (mgr.34583) 26 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:28.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:28 smithi062 bash[67442]: cluster 2024-02-22T19:13:27.629910+0000 mgr.x (mgr.34583) 26 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:28.985 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:28 smithi062 systemd[1]: Stopping Ceph alertmanager.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:13:28.985 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:28 smithi062 bash[79699]: ts=2024-02-22T19:13:28.707Z caller=main.go:594 level=info msg="Received SIGTERM, exiting gracefully..." 2024-02-22T19:13:29.282 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:29 smithi062 podman[86466]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-alertmanager.a 2024-02-22T19:13:29.650 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:29 smithi062 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@alertmanager.a.service: Succeeded. 2024-02-22T19:13:29.650 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:29 smithi062 systemd[1]: Stopped Ceph alertmanager.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:13:29.650 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:29 smithi062 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@alertmanager.a.service: Found left-over process 79757 (conmon) in control group while starting unit. Ignoring. 2024-02-22T19:13:29.650 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:29 smithi062 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2024-02-22T19:13:29.650 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:29 smithi062 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@alertmanager.a.service: Found left-over process 86486 (podman) in control group while starting unit. Ignoring. 2024-02-22T19:13:29.650 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:29 smithi062 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2024-02-22T19:13:29.650 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:29 smithi062 systemd[1]: Starting Ceph alertmanager.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:13:29.650 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:29 smithi062 podman[86504]: Error: no container with ID or name "ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-alertmanager.a" found: no such container 2024-02-22T19:13:29.650 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:29 smithi062 systemd[1]: Started Ceph alertmanager.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:13:29.917 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[64101]: audit 2024-02-22T19:13:29.350599+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:29.918 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[64101]: audit 2024-02-22T19:13:29.351671+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:29.918 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[67442]: audit 2024-02-22T19:13:29.350599+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:29.918 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[64101]: audit 2024-02-22T19:13:29.355812+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:13:29.918 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[64101]: audit 2024-02-22T19:13:29.357157+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:13:29.919 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[64101]: audit 2024-02-22T19:13:29.357985+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:13:29.919 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[64101]: audit 2024-02-22T19:13:29.358689+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:13:29.919 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[64101]: audit 2024-02-22T19:13:29.359770+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-22T19:13:29.919 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[67442]: audit 2024-02-22T19:13:29.351671+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:29.919 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[67442]: audit 2024-02-22T19:13:29.355812+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:13:29.919 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[67442]: audit 2024-02-22T19:13:29.357157+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:13:29.919 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[67442]: audit 2024-02-22T19:13:29.357985+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:13:29.919 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[67442]: audit 2024-02-22T19:13:29.358689+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:13:29.919 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[67442]: audit 2024-02-22T19:13:29.359770+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-22T19:13:29.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:29 smithi063 bash[35391]: audit 2024-02-22T19:13:29.350599+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:29.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:29 smithi063 bash[35391]: audit 2024-02-22T19:13:29.351671+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:29.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:29 smithi063 bash[35391]: audit 2024-02-22T19:13:29.355812+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"5a701a128b9c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301151027, \"cpu_percentage\": \"3.76%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549195Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:02:50.738589Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:04:50.001577Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:13:29.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:29 smithi063 bash[35391]: audit 2024-02-22T19:13:29.357157+0000 mon.b (mon.2) 116 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:13:29.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:29 smithi063 bash[35391]: audit 2024-02-22T19:13:29.357985+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:13:29.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:29 smithi063 bash[35391]: audit 2024-02-22T19:13:29.358689+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:13:29.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:29 smithi063 bash[35391]: audit 2024-02-22T19:13:29.359770+0000 mon.b (mon.2) 119 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-22T19:13:30.234 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[86519]: ts=2024-02-22T19:13:29.841Z caller=main.go:245 level=info msg="Starting Alertmanager" version="(version=0.26.0, branch=HEAD, revision=d7b4f0c7322e7151d6e3b1e31cbc15361e295d8d)" 2024-02-22T19:13:30.234 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[86519]: ts=2024-02-22T19:13:29.841Z caller=main.go:246 level=info build_context="(go=go1.20.7, platform=linux/amd64, user=root@df8d7debeef4, date=20230824-11:11:58, tags=netgo)" 2024-02-22T19:13:30.234 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[86519]: ts=2024-02-22T19:13:29.841Z caller=cluster.go:186 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.62 port=9094 2024-02-22T19:13:30.234 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[86519]: ts=2024-02-22T19:13:29.843Z caller=cluster.go:683 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-22T19:13:30.234 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[86519]: ts=2024-02-22T19:13:29.865Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-22T19:13:30.234 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[86519]: ts=2024-02-22T19:13:29.865Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-22T19:13:30.234 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[86519]: ts=2024-02-22T19:13:29.868Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9093 2024-02-22T19:13:30.234 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:29 smithi062 bash[86519]: ts=2024-02-22T19:13:29.868Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-02-22T19:13:30.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:30 smithi063 bash[35391]: cephadm 2024-02-22T19:13:29.356821+0000 mgr.x (mgr.34583) 27 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-22T19:13:30.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:30 smithi063 bash[35391]: cephadm 2024-02-22T19:13:29.359338+0000 mgr.x (mgr.34583) 28 : cephadm [INF] Reconfiguring daemon mon.b on smithi063 2024-02-22T19:13:30.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:30 smithi063 bash[35391]: cluster 2024-02-22T19:13:29.630352+0000 mgr.x (mgr.34583) 29 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:30.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:30 smithi062 bash[64101]: cephadm 2024-02-22T19:13:29.356821+0000 mgr.x (mgr.34583) 27 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-22T19:13:30.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:30 smithi062 bash[64101]: cephadm 2024-02-22T19:13:29.359338+0000 mgr.x (mgr.34583) 28 : cephadm [INF] Reconfiguring daemon mon.b on smithi063 2024-02-22T19:13:30.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:30 smithi062 bash[64101]: cluster 2024-02-22T19:13:29.630352+0000 mgr.x (mgr.34583) 29 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:30.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:30 smithi062 bash[67442]: cephadm 2024-02-22T19:13:29.356821+0000 mgr.x (mgr.34583) 27 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-22T19:13:30.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:30 smithi062 bash[67442]: cephadm 2024-02-22T19:13:29.359338+0000 mgr.x (mgr.34583) 28 : cephadm [INF] Reconfiguring daemon mon.b on smithi063 2024-02-22T19:13:30.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:30 smithi062 bash[67442]: cluster 2024-02-22T19:13:29.630352+0000 mgr.x (mgr.34583) 29 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:31.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:31 smithi063 bash[35391]: audit 2024-02-22T19:13:31.087048+0000 mon.b (mon.2) 120 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 30219960, \"cpu_percentage\": \"0.23%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201804Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:08:50.304019Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:18.202109Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:31.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:31 smithi063 bash[35391]: audit 2024-02-22T19:13:31.087880+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 30219960, \"cpu_percentage\": \"0.23%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201804Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:08:50.304019Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:18.202109Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:31.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:31 smithi063 bash[35391]: audit 2024-02-22T19:13:31.091299+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 30219960, \"cpu_percentage\": \"0.23%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201804Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:08:50.304019Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:18.202109Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:13:31.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:31 smithi063 bash[35391]: cephadm 2024-02-22T19:13:31.092529+0000 mgr.x (mgr.34583) 30 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-22T19:13:31.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:31 smithi063 bash[35391]: cephadm 2024-02-22T19:13:31.100136+0000 mgr.x (mgr.34583) 31 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi063 2024-02-22T19:13:31.984 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:31 smithi062 bash[86519]: ts=2024-02-22T19:13:31.843Z caller=cluster.go:708 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000550703s 2024-02-22T19:13:31.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:31 smithi062 bash[64101]: audit 2024-02-22T19:13:31.087048+0000 mon.b (mon.2) 120 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 30219960, \"cpu_percentage\": \"0.23%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201804Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:08:50.304019Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:18.202109Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:31.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:31 smithi062 bash[67442]: audit 2024-02-22T19:13:31.087048+0000 mon.b (mon.2) 120 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 30219960, \"cpu_percentage\": \"0.23%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201804Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:08:50.304019Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:18.202109Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:31.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:31 smithi062 bash[64101]: audit 2024-02-22T19:13:31.087880+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 30219960, \"cpu_percentage\": \"0.23%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201804Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:08:50.304019Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:18.202109Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:31.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:31 smithi062 bash[64101]: audit 2024-02-22T19:13:31.091299+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 30219960, \"cpu_percentage\": \"0.23%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201804Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:08:50.304019Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:18.202109Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:13:31.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:31 smithi062 bash[64101]: cephadm 2024-02-22T19:13:31.092529+0000 mgr.x (mgr.34583) 30 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-22T19:13:31.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:31 smithi062 bash[64101]: cephadm 2024-02-22T19:13:31.100136+0000 mgr.x (mgr.34583) 31 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi063 2024-02-22T19:13:31.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:31 smithi062 bash[67442]: audit 2024-02-22T19:13:31.087880+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 30219960, \"cpu_percentage\": \"0.23%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201804Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:08:50.304019Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:18.202109Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:13:31.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:31 smithi062 bash[67442]: audit 2024-02-22T19:13:31.091299+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"df5dba6a5dc9\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 30219960, \"cpu_percentage\": \"0.23%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201804Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:08:50.304019Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:08:46.332060Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:13:18.202109Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:13:31.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:31 smithi062 bash[67442]: cephadm 2024-02-22T19:13:31.092529+0000 mgr.x (mgr.34583) 30 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-22T19:13:31.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:31 smithi062 bash[67442]: cephadm 2024-02-22T19:13:31.100136+0000 mgr.x (mgr.34583) 31 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi063 2024-02-22T19:13:33.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:33 smithi063 bash[35391]: cluster 2024-02-22T19:13:31.630806+0000 mgr.x (mgr.34583) 32 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:33.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:33 smithi062 bash[64101]: cluster 2024-02-22T19:13:31.630806+0000 mgr.x (mgr.34583) 32 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:33.484 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:33 smithi062 bash[67442]: cluster 2024-02-22T19:13:31.630806+0000 mgr.x (mgr.34583) 32 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:35.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:35 smithi063 bash[35391]: cluster 2024-02-22T19:13:33.631396+0000 mgr.x (mgr.34583) 33 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:35.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:35 smithi062 bash[64101]: cluster 2024-02-22T19:13:33.631396+0000 mgr.x (mgr.34583) 33 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:35.484 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:35 smithi062 bash[67442]: cluster 2024-02-22T19:13:33.631396+0000 mgr.x (mgr.34583) 33 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:36.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:36 smithi063 bash[35391]: cluster 2024-02-22T19:13:35.631722+0000 mgr.x (mgr.34583) 34 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:36.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:36 smithi062 bash[64101]: cluster 2024-02-22T19:13:35.631722+0000 mgr.x (mgr.34583) 34 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:36.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:36 smithi062 bash[67442]: cluster 2024-02-22T19:13:35.631722+0000 mgr.x (mgr.34583) 34 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:38.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:38 smithi063 bash[35391]: cluster 2024-02-22T19:13:37.632478+0000 mgr.x (mgr.34583) 35 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:38.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:38 smithi062 bash[64101]: cluster 2024-02-22T19:13:37.632478+0000 mgr.x (mgr.34583) 35 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:38.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:38 smithi062 bash[67442]: cluster 2024-02-22T19:13:37.632478+0000 mgr.x (mgr.34583) 35 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:40.234 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:13:39 smithi062 bash[86519]: ts=2024-02-22T19:13:39.846Z caller=cluster.go:700 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003048093s 2024-02-22T19:13:40.464 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 systemd[1]: Stopping Ceph prometheus.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:13:40.464 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 bash[45557]: ts=2024-02-22T19:13:40.196Z caller=main.go:953 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-02-22T19:13:40.464 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 bash[45557]: ts=2024-02-22T19:13:40.196Z caller=main.go:977 level=info msg="Stopping scrape discovery manager..." 2024-02-22T19:13:40.464 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 bash[45557]: ts=2024-02-22T19:13:40.196Z caller=main.go:991 level=info msg="Stopping notify discovery manager..." 2024-02-22T19:13:40.464 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 bash[45557]: ts=2024-02-22T19:13:40.196Z caller=manager.go:160 level=info component="rule manager" msg="Stopping rule manager..." 2024-02-22T19:13:40.464 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 bash[45557]: ts=2024-02-22T19:13:40.196Z caller=manager.go:170 level=info component="rule manager" msg="Rule manager stopped" 2024-02-22T19:13:40.464 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 bash[45557]: ts=2024-02-22T19:13:40.196Z caller=main.go:1028 level=info msg="Stopping scrape manager..." 2024-02-22T19:13:40.464 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 bash[45557]: ts=2024-02-22T19:13:40.196Z caller=main.go:973 level=info msg="Scrape discovery manager stopped" 2024-02-22T19:13:40.464 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 bash[45557]: ts=2024-02-22T19:13:40.196Z caller=main.go:987 level=info msg="Notify discovery manager stopped" 2024-02-22T19:13:40.465 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 bash[45557]: ts=2024-02-22T19:13:40.197Z caller=main.go:1020 level=info msg="Scrape manager stopped" 2024-02-22T19:13:40.465 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 bash[45557]: ts=2024-02-22T19:13:40.197Z caller=notifier.go:604 level=info component=notifier msg="Stopping notification manager..." 2024-02-22T19:13:40.465 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 bash[45557]: ts=2024-02-22T19:13:40.197Z caller=main.go:1250 level=info msg="Notifier manager stopped" 2024-02-22T19:13:40.465 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 bash[45557]: ts=2024-02-22T19:13:40.197Z caller=main.go:1262 level=info msg="See you next time!" 2024-02-22T19:13:40.896 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:40 smithi063 bash[35391]: cluster 2024-02-22T19:13:39.633035+0000 mgr.x (mgr.34583) 36 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:40.896 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 podman[50066]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-prometheus.a 2024-02-22T19:13:40.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:40 smithi062 bash[64101]: cluster 2024-02-22T19:13:39.633035+0000 mgr.x (mgr.34583) 36 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:40.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:40 smithi062 bash[67442]: cluster 2024-02-22T19:13:39.633035+0000 mgr.x (mgr.34583) 36 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:41.213 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@prometheus.a.service: Succeeded. 2024-02-22T19:13:41.214 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 systemd[1]: Stopped Ceph prometheus.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:13:41.214 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@prometheus.a.service: Found left-over process 45572 (conmon) in control group while starting unit. Ignoring. 2024-02-22T19:13:41.214 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2024-02-22T19:13:41.214 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@prometheus.a.service: Found left-over process 50086 (podman) in control group while starting unit. Ignoring. 2024-02-22T19:13:41.214 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2024-02-22T19:13:41.214 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 systemd[1]: Starting Ceph prometheus.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:13:41.214 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 podman[50105]: Error: no container with ID or name "ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-prometheus.a" found: no such container 2024-02-22T19:13:41.214 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:40 smithi063 systemd[1]: Started Ceph prometheus.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:13:41.964 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.505Z caller=main.go:564 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-02-22T19:13:41.964 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.505Z caller=main.go:608 level=info msg="Starting Prometheus Server" mode=server version="(version=2.50.0, branch=HEAD, revision=814b920e8a6345d35712b5857ebd4cb5e90fc107)" 2024-02-22T19:13:41.964 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.505Z caller=main.go:613 level=info build_context="(go=go1.21.7, platform=linux/amd64, user=root@384077e1cf50, date=20240222-09:38:19, tags=netgo,builtinassets,stringlabels)" 2024-02-22T19:13:41.964 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.505Z caller=main.go:614 level=info host_details="(Linux 4.18.0-540.el8.x86_64 #1 SMP Fri Feb 9 14:58:00 UTC 2024 x86_64 smithi063 (none))" 2024-02-22T19:13:41.964 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.505Z caller=main.go:615 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-02-22T19:13:41.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.505Z caller=main.go:616 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-22T19:13:41.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.506Z caller=web.go:565 level=info component=web msg="Start listening for connections" address=:9095 2024-02-22T19:13:41.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.507Z caller=main.go:1118 level=info msg="Starting TSDB ..." 2024-02-22T19:13:41.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.509Z caller=tls_config.go:313 level=info component=web msg="Listening on" address=[::]:9095 2024-02-22T19:13:41.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.509Z caller=tls_config.go:316 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-02-22T19:13:41.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.510Z caller=head.go:610 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-02-22T19:13:41.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.510Z caller=head.go:692 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.6µs 2024-02-22T19:13:41.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.510Z caller=head.go:700 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-02-22T19:13:41.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.511Z caller=head.go:771 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=2 2024-02-22T19:13:41.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.519Z caller=head.go:771 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=2 2024-02-22T19:13:41.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.519Z caller=head.go:771 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=2 2024-02-22T19:13:41.965 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.519Z caller=head.go:808 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=39.048µs wal_replay_duration=8.844677ms wbl_replay_duration=111ns total_replay_duration=8.902877ms 2024-02-22T19:13:41.966 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.521Z caller=main.go:1139 level=info fs_type=XFS_SUPER_MAGIC 2024-02-22T19:13:41.966 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.521Z caller=main.go:1142 level=info msg="TSDB started" 2024-02-22T19:13:41.966 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.521Z caller=main.go:1324 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-22T19:13:41.966 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.535Z caller=main.go:1361 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=14.139814ms db_storage=1.056µs remote_storage=1.053µs web_handler=309ns query_engine=595ns scrape=237.326µs scrape_sd=24.199µs notify=15.734µs notify_sd=4.934µs rules=13.646759ms tracing=6.029µs 2024-02-22T19:13:41.966 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.535Z caller=main.go:1103 level=info msg="Server is ready to receive web requests." 2024-02-22T19:13:41.966 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[50123]: ts=2024-02-22T19:13:41.535Z caller=manager.go:146 level=info component="rule manager" msg="Starting rule manager..." 2024-02-22T19:13:41.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[35391]: audit 2024-02-22T19:13:40.962786+0000 mon.b (mon.2) 121 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:41.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[35391]: audit 2024-02-22T19:13:40.963561+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:41.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[35391]: audit 2024-02-22T19:13:40.966869+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:13:41.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[35391]: audit 2024-02-22T19:13:40.972132+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T19:13:41.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[35391]: audit 2024-02-22T19:13:40.972684+0000 mgr.x (mgr.34583) 37 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T19:13:41.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[35391]: audit 2024-02-22T19:13:40.973598+0000 mon.b (mon.2) 123 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi062.front.sepia.ceph.com:9093"}]: dispatch 2024-02-22T19:13:41.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[35391]: audit 2024-02-22T19:13:40.973978+0000 mgr.x (mgr.34583) 38 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi062.front.sepia.ceph.com:9093"}]: dispatch 2024-02-22T19:13:41.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[35391]: audit 2024-02-22T19:13:40.974227+0000 mon.b (mon.2) 124 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi062.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-02-22T19:13:41.968 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[35391]: audit 2024-02-22T19:13:40.974754+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi062.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-02-22T19:13:41.968 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[35391]: audit 2024-02-22T19:13:40.978876+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi062.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2024-02-22T19:13:41.968 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[35391]: audit 2024-02-22T19:13:40.986016+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T19:13:41.968 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[35391]: audit 2024-02-22T19:13:40.986420+0000 mgr.x (mgr.34583) 39 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T19:13:41.968 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[35391]: audit 2024-02-22T19:13:40.989653+0000 mon.b (mon.2) 126 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi063.front.sepia.ceph.com:9095"}]: dispatch 2024-02-22T19:13:41.968 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[35391]: audit 2024-02-22T19:13:40.989983+0000 mgr.x (mgr.34583) 40 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi063.front.sepia.ceph.com:9095"}]: dispatch 2024-02-22T19:13:41.968 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[35391]: audit 2024-02-22T19:13:40.990346+0000 mon.b (mon.2) 127 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi063.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-02-22T19:13:41.968 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[35391]: audit 2024-02-22T19:13:40.990885+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi063.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-02-22T19:13:41.968 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[35391]: audit 2024-02-22T19:13:40.995068+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi063.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2024-02-22T19:13:41.968 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:41 smithi063 bash[35391]: cephadm 2024-02-22T19:13:40.998969+0000 mgr.x (mgr.34583) 41 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 2024-02-22T19:13:41.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[64101]: audit 2024-02-22T19:13:40.962786+0000 mon.b (mon.2) 121 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:41.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[67442]: audit 2024-02-22T19:13:40.962786+0000 mon.b (mon.2) 121 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:41.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[64101]: audit 2024-02-22T19:13:40.963561+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:41.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[64101]: audit 2024-02-22T19:13:40.966869+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:13:41.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[64101]: audit 2024-02-22T19:13:40.972132+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T19:13:41.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[64101]: audit 2024-02-22T19:13:40.972684+0000 mgr.x (mgr.34583) 37 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T19:13:41.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[64101]: audit 2024-02-22T19:13:40.973598+0000 mon.b (mon.2) 123 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi062.front.sepia.ceph.com:9093"}]: dispatch 2024-02-22T19:13:41.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[64101]: audit 2024-02-22T19:13:40.973978+0000 mgr.x (mgr.34583) 38 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi062.front.sepia.ceph.com:9093"}]: dispatch 2024-02-22T19:13:41.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[67442]: audit 2024-02-22T19:13:40.963561+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:41.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[67442]: audit 2024-02-22T19:13:40.966869+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98775859, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201335Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"29.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:13:18.201481Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46619688, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201552Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43641733, \"cpu_percentage\": \"0.58%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201617Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43243274, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201680Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45801799, \"cpu_percentage\": \"0.61%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201742Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13274972, \"cpu_percentage\": \"0.38%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201864Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31163678, \"cpu_percentage\": \"0.49%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201924Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33082572, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:18.201996Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:13:41.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[67442]: audit 2024-02-22T19:13:40.972132+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T19:13:41.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[67442]: audit 2024-02-22T19:13:40.972684+0000 mgr.x (mgr.34583) 37 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-22T19:13:41.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[67442]: audit 2024-02-22T19:13:40.973598+0000 mon.b (mon.2) 123 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi062.front.sepia.ceph.com:9093"}]: dispatch 2024-02-22T19:13:41.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[67442]: audit 2024-02-22T19:13:40.973978+0000 mgr.x (mgr.34583) 38 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi062.front.sepia.ceph.com:9093"}]: dispatch 2024-02-22T19:13:41.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[64101]: audit 2024-02-22T19:13:40.974227+0000 mon.b (mon.2) 124 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi062.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-02-22T19:13:41.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[64101]: audit 2024-02-22T19:13:40.974754+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi062.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-02-22T19:13:41.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[64101]: audit 2024-02-22T19:13:40.978876+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi062.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2024-02-22T19:13:41.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[64101]: audit 2024-02-22T19:13:40.986016+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T19:13:41.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[64101]: audit 2024-02-22T19:13:40.986420+0000 mgr.x (mgr.34583) 39 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T19:13:41.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[64101]: audit 2024-02-22T19:13:40.989653+0000 mon.b (mon.2) 126 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi063.front.sepia.ceph.com:9095"}]: dispatch 2024-02-22T19:13:41.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[64101]: audit 2024-02-22T19:13:40.989983+0000 mgr.x (mgr.34583) 40 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi063.front.sepia.ceph.com:9095"}]: dispatch 2024-02-22T19:13:41.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[64101]: audit 2024-02-22T19:13:40.990346+0000 mon.b (mon.2) 127 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi063.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-02-22T19:13:41.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[64101]: audit 2024-02-22T19:13:40.990885+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi063.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-02-22T19:13:41.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[64101]: audit 2024-02-22T19:13:40.995068+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi063.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2024-02-22T19:13:41.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[64101]: cephadm 2024-02-22T19:13:40.998969+0000 mgr.x (mgr.34583) 41 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 2024-02-22T19:13:41.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[67442]: audit 2024-02-22T19:13:40.974227+0000 mon.b (mon.2) 124 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi062.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-02-22T19:13:41.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[67442]: audit 2024-02-22T19:13:40.974754+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi062.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-02-22T19:13:41.988 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[67442]: audit 2024-02-22T19:13:40.978876+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi062.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2024-02-22T19:13:41.989 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[67442]: audit 2024-02-22T19:13:40.986016+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T19:13:41.989 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[67442]: audit 2024-02-22T19:13:40.986420+0000 mgr.x (mgr.34583) 39 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-22T19:13:41.989 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[67442]: audit 2024-02-22T19:13:40.989653+0000 mon.b (mon.2) 126 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi063.front.sepia.ceph.com:9095"}]: dispatch 2024-02-22T19:13:41.989 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[67442]: audit 2024-02-22T19:13:40.989983+0000 mgr.x (mgr.34583) 40 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi063.front.sepia.ceph.com:9095"}]: dispatch 2024-02-22T19:13:41.989 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[67442]: audit 2024-02-22T19:13:40.990346+0000 mon.b (mon.2) 127 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi063.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-02-22T19:13:41.989 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[67442]: audit 2024-02-22T19:13:40.990885+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi063.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-02-22T19:13:41.989 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[67442]: audit 2024-02-22T19:13:40.995068+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi063.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2024-02-22T19:13:41.989 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:41 smithi062 bash[67442]: cephadm 2024-02-22T19:13:40.998969+0000 mgr.x (mgr.34583) 41 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59 2024-02-22T19:13:43.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:43 smithi062 bash[64101]: cluster 2024-02-22T19:13:41.633455+0000 mgr.x (mgr.34583) 42 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:43.272 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:43 smithi062 bash[64101]: audit 2024-02-22T19:13:42.910410+0000 mon.b (mon.2) 128 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\", \"target_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"target_version\": \"16.2.14-550-geb66ed92\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-22T19:13:43.272 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:43 smithi062 bash[64101]: audit 2024-02-22T19:13:42.910900+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\", \"target_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"target_version\": \"16.2.14-550-geb66ed92\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-22T19:13:43.272 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:43 smithi062 bash[64101]: audit 2024-02-22T19:13:42.913757+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\", \"target_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"target_version\": \"16.2.14-550-geb66ed92\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-22T19:13:43.272 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:43 smithi062 bash[64101]: audit 2024-02-22T19:13:42.915653+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:13:43.272 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:43 smithi062 bash[64101]: audit 2024-02-22T19:13:42.916784+0000 mon.b (mon.2) 130 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:13:43.272 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:43 smithi062 bash[64101]: audit 2024-02-22T19:13:42.917311+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:13:43.272 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:43 smithi062 bash[64101]: audit 2024-02-22T19:13:42.923074+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2024-02-22T19:13:43.272 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:43 smithi062 bash[67442]: cluster 2024-02-22T19:13:41.633455+0000 mgr.x (mgr.34583) 42 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:43.272 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:43 smithi062 bash[67442]: audit 2024-02-22T19:13:42.910410+0000 mon.b (mon.2) 128 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\", \"target_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"target_version\": \"16.2.14-550-geb66ed92\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-22T19:13:43.273 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:43 smithi062 bash[67442]: audit 2024-02-22T19:13:42.910900+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\", \"target_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"target_version\": \"16.2.14-550-geb66ed92\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-22T19:13:43.273 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:43 smithi062 bash[67442]: audit 2024-02-22T19:13:42.913757+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\", \"target_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"target_version\": \"16.2.14-550-geb66ed92\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-22T19:13:43.273 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:43 smithi062 bash[67442]: audit 2024-02-22T19:13:42.915653+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:13:43.273 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:43 smithi062 bash[67442]: audit 2024-02-22T19:13:42.916784+0000 mon.b (mon.2) 130 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:13:43.273 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:43 smithi062 bash[67442]: audit 2024-02-22T19:13:42.917311+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:13:43.273 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:43 smithi062 bash[67442]: audit 2024-02-22T19:13:42.923074+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2024-02-22T19:13:43.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:43 smithi063 bash[35391]: cluster 2024-02-22T19:13:41.633455+0000 mgr.x (mgr.34583) 42 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:43.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:43 smithi063 bash[35391]: audit 2024-02-22T19:13:42.910410+0000 mon.b (mon.2) 128 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\", \"target_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"target_version\": \"16.2.14-550-geb66ed92\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-22T19:13:43.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:43 smithi063 bash[35391]: audit 2024-02-22T19:13:42.910900+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\", \"target_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"target_version\": \"16.2.14-550-geb66ed92\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-22T19:13:43.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:43 smithi063 bash[35391]: audit 2024-02-22T19:13:42.913757+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"progress_id\": \"5b62485a-2dba-4e9f-bb6d-2ed57083acf8\", \"target_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"target_version\": \"16.2.14-550-geb66ed92\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-22T19:13:43.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:43 smithi063 bash[35391]: audit 2024-02-22T19:13:42.915653+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:13:43.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:43 smithi063 bash[35391]: audit 2024-02-22T19:13:42.916784+0000 mon.b (mon.2) 130 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:13:43.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:43 smithi063 bash[35391]: audit 2024-02-22T19:13:42.917311+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:13:43.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:43 smithi063 bash[35391]: audit 2024-02-22T19:13:42.923074+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2024-02-22T19:13:43.842 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-02-22T19:13:44.388 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:44 smithi062 bash[64101]: cephadm 2024-02-22T19:13:42.914560+0000 mgr.x (mgr.34583) 43 : cephadm [INF] Upgrade: Target is version 16.2.14-550-geb66ed92 (pacific) 2024-02-22T19:13:44.388 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:44 smithi062 bash[64101]: cephadm 2024-02-22T19:13:42.914649+0000 mgr.x (mgr.34583) 44 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010, digests ['quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010'] 2024-02-22T19:13:44.388 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:44 smithi062 bash[64101]: cephadm 2024-02-22T19:13:42.924580+0000 mgr.x (mgr.34583) 45 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-22T19:13:44.388 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:44 smithi062 bash[64101]: cephadm 2024-02-22T19:13:42.925139+0000 mgr.x (mgr.34583) 46 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-22T19:13:44.388 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:44 smithi062 bash[67442]: cephadm 2024-02-22T19:13:42.914560+0000 mgr.x (mgr.34583) 43 : cephadm [INF] Upgrade: Target is version 16.2.14-550-geb66ed92 (pacific) 2024-02-22T19:13:44.388 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:44 smithi062 bash[67442]: cephadm 2024-02-22T19:13:42.914649+0000 mgr.x (mgr.34583) 44 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010, digests ['quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010'] 2024-02-22T19:13:44.388 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:44 smithi062 bash[67442]: cephadm 2024-02-22T19:13:42.924580+0000 mgr.x (mgr.34583) 45 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-22T19:13:44.388 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:44 smithi062 bash[67442]: cephadm 2024-02-22T19:13:42.925139+0000 mgr.x (mgr.34583) 46 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-22T19:13:44.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:44 smithi063 bash[35391]: cephadm 2024-02-22T19:13:42.914560+0000 mgr.x (mgr.34583) 43 : cephadm [INF] Upgrade: Target is version 16.2.14-550-geb66ed92 (pacific) 2024-02-22T19:13:44.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:44 smithi063 bash[35391]: cephadm 2024-02-22T19:13:42.914649+0000 mgr.x (mgr.34583) 44 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010, digests ['quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010'] 2024-02-22T19:13:44.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:44 smithi063 bash[35391]: cephadm 2024-02-22T19:13:42.924580+0000 mgr.x (mgr.34583) 45 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-22T19:13:44.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:44 smithi063 bash[35391]: cephadm 2024-02-22T19:13:42.925139+0000 mgr.x (mgr.34583) 46 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-22T19:13:44.490 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T19:13:44.490 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.a smithi062 starting - - - - 2024-02-22T19:13:44.490 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.a smithi063 running (5m) 26s ago 5m 29.7M - 6.6.2 87a51ecf0b1c 9863e2980fa6 2024-02-22T19:13:44.490 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.x smithi063 running (55s) 26s ago 8m 415M - 16.2.14-550-geb66ed92 7403d1862307 c7743467a258 2024-02-22T19:13:44.490 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.y smithi062 running (10m) 27s ago 10m 287M - 15.2.0 204a01f9b0b6 5a701a128b9c 2024-02-22T19:13:44.490 INFO:teuthology.orchestra.run.smithi062.stdout:mon.a smithi062 running (10m) 27s ago 11m 86.5M 2048M 15.2.0 204a01f9b0b6 edca537a955b 2024-02-22T19:13:44.490 INFO:teuthology.orchestra.run.smithi062.stdout:mon.b smithi063 running (9m) 26s ago 9m 94.2M 2048M 15.2.0 204a01f9b0b6 deb740d884ca 2024-02-22T19:13:44.490 INFO:teuthology.orchestra.run.smithi062.stdout:mon.c smithi062 running (9m) 27s ago 9m 96.8M 2048M 15.2.0 204a01f9b0b6 921b06886416 2024-02-22T19:13:44.490 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.a smithi062 running (5m) 27s ago 5m 13.2M - 1.7.0 72c9c2088986 3e27c560bf7f 2024-02-22T19:13:44.490 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.b smithi063 running (5m) 26s ago 5m 12.6M - 1.7.0 72c9c2088986 ab2867e3fd57 2024-02-22T19:13:44.490 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (8m) 27s ago 8m 46.1M 4096M 15.2.0 204a01f9b0b6 e651beecc87d 2024-02-22T19:13:44.491 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (8m) 27s ago 8m 46.0M 4096M 15.2.0 204a01f9b0b6 d7a667155c4b 2024-02-22T19:13:44.491 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (7m) 27s ago 7m 39.9M 4096M 15.2.0 204a01f9b0b6 dc5ec198f96d 2024-02-22T19:13:44.491 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi062 running (7m) 27s ago 7m 42.2M 4096M 15.2.0 204a01f9b0b6 efb44063d52f 2024-02-22T19:13:44.491 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi063 running (7m) 26s ago 7m 44.4M 4096M 15.2.0 204a01f9b0b6 0affbe803c22 2024-02-22T19:13:44.491 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi063 running (6m) 26s ago 7m 41.6M 4096M 15.2.0 204a01f9b0b6 636665ed6108 2024-02-22T19:13:44.491 INFO:teuthology.orchestra.run.smithi062.stdout:osd.6 smithi063 running (6m) 26s ago 6m 41.2M 4096M 15.2.0 204a01f9b0b6 8c48e05bc7dd 2024-02-22T19:13:44.491 INFO:teuthology.orchestra.run.smithi062.stdout:osd.7 smithi063 running (6m) 26s ago 6m 43.6M 4096M 15.2.0 204a01f9b0b6 c298ad18c8bb 2024-02-22T19:13:44.491 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.a smithi063 starting - - - - 2024-02-22T19:13:44.491 INFO:teuthology.orchestra.run.smithi062.stdout:rgw.r.z.smithi062.zxmpna smithi062 running (4m) 27s ago 4m 32.5M - 15.2.0 204a01f9b0b6 45553891c2c4 2024-02-22T19:13:44.491 INFO:teuthology.orchestra.run.smithi062.stdout:rgw.r.z.smithi063.feyald smithi063 running (4m) 26s ago 4m 31.5M - 15.2.0 204a01f9b0b6 478364f15ee3 2024-02-22T19:13:44.896 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-22T19:13:44.896 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-02-22T19:13:44.896 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-22T19:13:44.896 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:13:44.896 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-02-22T19:13:44.896 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2024-02-22T19:13:44.896 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 1 2024-02-22T19:13:44.896 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:13:44.896 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-02-22T19:13:44.897 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-22T19:13:44.897 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:13:44.897 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": {}, 2024-02-22T19:13:44.897 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw": { 2024-02-22T19:13:44.897 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-22T19:13:44.897 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:13:44.897 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-02-22T19:13:44.897 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 14, 2024-02-22T19:13:44.897 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 1 2024-02-22T19:13:44.897 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-02-22T19:13:44.897 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-22T19:13:45.112 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: cluster 2024-02-22T19:13:43.634227+0000 mgr.x (mgr.34583) 47 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:45.112 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:43.830588+0000 mgr.x (mgr.34583) 48 : audit [DBG] from='client.24781 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:45.112 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.154867+0000 mgr.x (mgr.34583) 49 : audit [DBG] from='client.24787 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:45.112 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.405778+0000 mon.b (mon.2) 131 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr.y"}]: dispatch 2024-02-22T19:13:45.112 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.406224+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr.y"}]: dispatch 2024-02-22T19:13:45.112 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.409812+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr.y"}]': finished 2024-02-22T19:13:45.112 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.411289+0000 mon.b (mon.2) 132 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:13:45.112 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.411597+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:13:45.112 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.412495+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T19:13:45.112 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.413430+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:13:45.112 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.414603+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-22T19:13:45.112 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.478790+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:13:45.113 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.479270+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:13:45.113 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.479697+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.113 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.480138+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: cluster 2024-02-22T19:13:43.634227+0000 mgr.x (mgr.34583) 47 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:45.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:43.830588+0000 mgr.x (mgr.34583) 48 : audit [DBG] from='client.24781 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:45.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.154867+0000 mgr.x (mgr.34583) 49 : audit [DBG] from='client.24787 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:45.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.405778+0000 mon.b (mon.2) 131 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr.y"}]: dispatch 2024-02-22T19:13:45.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.406224+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr.y"}]: dispatch 2024-02-22T19:13:45.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.409812+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr.y"}]': finished 2024-02-22T19:13:45.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.411289+0000 mon.b (mon.2) 132 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:13:45.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.411597+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:13:45.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.412495+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T19:13:45.114 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.413430+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:13:45.114 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.414603+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-22T19:13:45.114 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.478790+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:13:45.114 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.479270+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:13:45.114 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.479697+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.114 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.480138+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.480546+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.480957+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.482990+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:13:45.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.483433+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.483859+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.484310+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.484721+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[64101]: audit 2024-02-22T19:13:44.895409+0000 mon.a (mon.0) 652 : audit [DBG] from='client.? 172.21.15.62:0/519435409' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:13:45.115 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.480546+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.115 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.480957+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.115 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.482990+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:13:45.115 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.483433+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.115 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.483859+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.115 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.484310+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.115 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.484721+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.115 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:45 smithi062 bash[67442]: audit 2024-02-22T19:13:44.895409+0000 mon.a (mon.0) 652 : audit [DBG] from='client.? 172.21.15.62:0/519435409' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:13:45.229 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-22T19:13:45.230 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", 2024-02-22T19:13:45.230 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-02-22T19:13:45.230 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T19:13:45.230 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [], 2024-02-22T19:13:45.230 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "1/20 daemons upgraded", 2024-02-22T19:13:45.230 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Currently upgrading mgr daemons", 2024-02-22T19:13:45.230 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-02-22T19:13:45.230 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-22T19:13:45.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: cluster 2024-02-22T19:13:43.634227+0000 mgr.x (mgr.34583) 47 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:45.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:43.830588+0000 mgr.x (mgr.34583) 48 : audit [DBG] from='client.24781 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:45.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.154867+0000 mgr.x (mgr.34583) 49 : audit [DBG] from='client.24787 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:45.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.405778+0000 mon.b (mon.2) 131 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr.y"}]: dispatch 2024-02-22T19:13:45.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.406224+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr.y"}]: dispatch 2024-02-22T19:13:45.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.409812+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr.y"}]': finished 2024-02-22T19:13:45.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.411289+0000 mon.b (mon.2) 132 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:13:45.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.411597+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:13:45.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.412495+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T19:13:45.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.413430+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:13:45.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.414603+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-22T19:13:45.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.478790+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:13:45.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.479270+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:13:45.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.479697+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.480138+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.480546+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.480957+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.482990+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:13:45.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.483433+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.483859+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.484310+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.484721+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:13:45.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:45 smithi063 bash[35391]: audit 2024-02-22T19:13:44.895409+0000 mon.a (mon.0) 652 : audit [DBG] from='client.? 172.21.15.62:0/519435409' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:13:46.234 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:13:46 smithi062 systemd[1]: Stopping Ceph mgr.y for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:13:46.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:46 smithi062 bash[64101]: cephadm 2024-02-22T19:13:44.405418+0000 mgr.x (mgr.34583) 50 : cephadm [INF] Upgrade: Updating mgr.y 2024-02-22T19:13:46.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:46 smithi062 bash[64101]: cephadm 2024-02-22T19:13:44.414152+0000 mgr.x (mgr.34583) 51 : cephadm [INF] Deploying daemon mgr.y on smithi062 2024-02-22T19:13:46.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:46 smithi062 bash[64101]: audit 2024-02-22T19:13:44.476682+0000 mgr.x (mgr.34583) 52 : audit [DBG] from='client.24793 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:46.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:46 smithi062 bash[64101]: audit 2024-02-22T19:13:45.229358+0000 mgr.x (mgr.34583) 53 : audit [DBG] from='client.24805 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:46.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:46 smithi062 bash[67442]: cephadm 2024-02-22T19:13:44.405418+0000 mgr.x (mgr.34583) 50 : cephadm [INF] Upgrade: Updating mgr.y 2024-02-22T19:13:46.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:46 smithi062 bash[67442]: cephadm 2024-02-22T19:13:44.414152+0000 mgr.x (mgr.34583) 51 : cephadm [INF] Deploying daemon mgr.y on smithi062 2024-02-22T19:13:46.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:46 smithi062 bash[67442]: audit 2024-02-22T19:13:44.476682+0000 mgr.x (mgr.34583) 52 : audit [DBG] from='client.24793 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:46.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:46 smithi062 bash[67442]: audit 2024-02-22T19:13:45.229358+0000 mgr.x (mgr.34583) 53 : audit [DBG] from='client.24805 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:46.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:46 smithi063 bash[35391]: cephadm 2024-02-22T19:13:44.405418+0000 mgr.x (mgr.34583) 50 : cephadm [INF] Upgrade: Updating mgr.y 2024-02-22T19:13:46.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:46 smithi063 bash[35391]: cephadm 2024-02-22T19:13:44.414152+0000 mgr.x (mgr.34583) 51 : cephadm [INF] Deploying daemon mgr.y on smithi062 2024-02-22T19:13:46.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:46 smithi063 bash[35391]: audit 2024-02-22T19:13:44.476682+0000 mgr.x (mgr.34583) 52 : audit [DBG] from='client.24793 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:46.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:46 smithi063 bash[35391]: audit 2024-02-22T19:13:45.229358+0000 mgr.x (mgr.34583) 53 : audit [DBG] from='client.24805 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:13:47.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:47 smithi063 bash[35391]: cluster 2024-02-22T19:13:45.634656+0000 mgr.x (mgr.34583) 54 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:47.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:47 smithi062 bash[64101]: cluster 2024-02-22T19:13:45.634656+0000 mgr.x (mgr.34583) 54 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:47.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:47 smithi062 bash[67442]: cluster 2024-02-22T19:13:45.634656+0000 mgr.x (mgr.34583) 54 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:49.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:49 smithi063 bash[35391]: cluster 2024-02-22T19:13:47.635514+0000 mgr.x (mgr.34583) 55 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:49.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:49 smithi062 bash[64101]: cluster 2024-02-22T19:13:47.635514+0000 mgr.x (mgr.34583) 55 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:49.484 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:49 smithi062 bash[67442]: cluster 2024-02-22T19:13:47.635514+0000 mgr.x (mgr.34583) 55 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:51.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:51 smithi063 bash[35391]: cluster 2024-02-22T19:13:49.635908+0000 mgr.x (mgr.34583) 56 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:51.487 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:51 smithi062 bash[64101]: cluster 2024-02-22T19:13:49.635908+0000 mgr.x (mgr.34583) 56 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:51.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:51 smithi062 bash[67442]: cluster 2024-02-22T19:13:49.635908+0000 mgr.x (mgr.34583) 56 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:53.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:53 smithi063 bash[35391]: cluster 2024-02-22T19:13:51.636326+0000 mgr.x (mgr.34583) 57 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:53.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:53 smithi062 bash[64101]: cluster 2024-02-22T19:13:51.636326+0000 mgr.x (mgr.34583) 57 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:53.484 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:53 smithi062 bash[67442]: cluster 2024-02-22T19:13:51.636326+0000 mgr.x (mgr.34583) 57 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:55.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:55 smithi063 bash[35391]: cluster 2024-02-22T19:13:53.637090+0000 mgr.x (mgr.34583) 58 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:55.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:55 smithi062 bash[64101]: cluster 2024-02-22T19:13:53.637090+0000 mgr.x (mgr.34583) 58 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:55.484 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:55 smithi062 bash[67442]: cluster 2024-02-22T19:13:53.637090+0000 mgr.x (mgr.34583) 58 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:56.484 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:13:56 smithi062 bash[87016]: time="2024-02-22T19:13:56Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr.y in 10 seconds, resorting to SIGKILL" 2024-02-22T19:13:56.846 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:56 smithi062 bash[64101]: cluster 2024-02-22T19:13:55.637462+0000 mgr.x (mgr.34583) 59 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:56.847 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:13:56 smithi062 bash[87016]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr.y 2024-02-22T19:13:56.847 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:56 smithi062 bash[67442]: cluster 2024-02-22T19:13:55.637462+0000 mgr.x (mgr.34583) 59 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:56.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:56 smithi063 bash[35391]: cluster 2024-02-22T19:13:55.637462+0000 mgr.x (mgr.34583) 59 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:57.234 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:13:56 smithi062 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mgr.y.service: Main process exited, code=exited, status=137/n/a 2024-02-22T19:13:57.735 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:13:57 smithi062 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mgr.y.service: Failed with result 'exit-code'. 2024-02-22T19:13:57.735 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:13:57 smithi062 systemd[1]: Stopped Ceph mgr.y for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:13:57.735 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:13:57 smithi062 systemd[1]: Starting Ceph mgr.y for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:13:58.694 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:13:58 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:13:58.411+0000 7f807d153700 1 -- 172.21.15.62:0/1670817960 <== mon.1 v2:172.21.15.62:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556fc49024e0 con 0x556fc48d7400 2024-02-22T19:13:58.694 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:13:58 smithi062 bash[87215]: 0310c48cbf40801245bb40873037bcbf694abcb8d238765c2a25c6a66b80e5f6 2024-02-22T19:13:58.694 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:13:58 smithi062 systemd[1]: Started Ceph mgr.y for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:13:58.694 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:13:58 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:13:58.546+0000 7f808d74e680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-22T19:13:58.694 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:13:58 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:13:58.633+0000 7f808d74e680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-22T19:13:58.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:58 smithi063 bash[35391]: cluster 2024-02-22T19:13:57.639915+0000 mgr.x (mgr.34583) 60 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:58.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:58 smithi063 bash[35391]: audit 2024-02-22T19:13:58.544870+0000 mon.b (mon.2) 147 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:58.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:58 smithi063 bash[35391]: audit 2024-02-22T19:13:58.545531+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:58.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:58 smithi063 bash[35391]: audit 2024-02-22T19:13:58.548430+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:13:58.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:58 smithi063 bash[35391]: audit 2024-02-22T19:13:58.550027+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:13:58.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:58 smithi063 bash[35391]: audit 2024-02-22T19:13:58.552205+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:13:58.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:58 smithi062 bash[67442]: cluster 2024-02-22T19:13:57.639915+0000 mgr.x (mgr.34583) 60 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:58.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:58 smithi062 bash[64101]: cluster 2024-02-22T19:13:57.639915+0000 mgr.x (mgr.34583) 60 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:13:58.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:58 smithi062 bash[67442]: audit 2024-02-22T19:13:58.544870+0000 mon.b (mon.2) 147 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:58.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:58 smithi062 bash[64101]: audit 2024-02-22T19:13:58.544870+0000 mon.b (mon.2) 147 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:58.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:58 smithi062 bash[67442]: audit 2024-02-22T19:13:58.545531+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:58.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:58 smithi062 bash[64101]: audit 2024-02-22T19:13:58.545531+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:58.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:58 smithi062 bash[67442]: audit 2024-02-22T19:13:58.548430+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:13:58.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:58 smithi062 bash[67442]: audit 2024-02-22T19:13:58.550027+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:13:58.987 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:58 smithi062 bash[67442]: audit 2024-02-22T19:13:58.552205+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:13:58.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:58 smithi062 bash[64101]: audit 2024-02-22T19:13:58.548430+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:18.769851Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:13:58.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:58 smithi062 bash[64101]: audit 2024-02-22T19:13:58.550027+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:13:58.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:58 smithi062 bash[64101]: audit 2024-02-22T19:13:58.552205+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:13:59.483 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:13:59 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:13:59.038+0000 7f808d74e680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-22T19:13:59.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:59 smithi063 bash[35391]: audit 2024-02-22T19:13:58.799672+0000 mon.b (mon.2) 150 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:59.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:59 smithi063 bash[35391]: audit 2024-02-22T19:13:58.800264+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:59.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:59 smithi063 bash[35391]: audit 2024-02-22T19:13:58.802979+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:13:59.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:13:59 smithi063 bash[35391]: audit 2024-02-22T19:13:58.806560+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:13:59.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:59 smithi062 bash[64101]: audit 2024-02-22T19:13:58.799672+0000 mon.b (mon.2) 150 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:59.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:59 smithi062 bash[67442]: audit 2024-02-22T19:13:58.799672+0000 mon.b (mon.2) 150 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:59.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:59 smithi062 bash[64101]: audit 2024-02-22T19:13:58.800264+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:59.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:59 smithi062 bash[67442]: audit 2024-02-22T19:13:58.800264+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:13:59.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:59 smithi062 bash[64101]: audit 2024-02-22T19:13:58.802979+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:13:59.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:13:59 smithi062 bash[64101]: audit 2024-02-22T19:13:58.806560+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:13:59.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:59 smithi062 bash[67442]: audit 2024-02-22T19:13:58.802979+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 90764738, \"cpu_percentage\": \"1.97%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549038Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101523128, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549269Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48412753, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549334Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48286924, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549396Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 41859153, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549458Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44323307, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549518Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13925089, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549579Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 34162606, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:13:16.549699Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:13:59.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:13:59 smithi062 bash[67442]: audit 2024-02-22T19:13:58.806560+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:14:00.198 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:13:59 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:13:59.885+0000 7f808d74e680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-22T19:14:00.198 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:13:59 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:13:59.967+0000 7f808d74e680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-22T19:14:00.484 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:00 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:00.197+0000 7f808d74e680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-22T19:14:01.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:00 smithi063 bash[35391]: cluster 2024-02-22T19:13:59.640373+0000 mgr.x (mgr.34583) 61 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:01.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:00 smithi062 bash[64101]: cluster 2024-02-22T19:13:59.640373+0000 mgr.x (mgr.34583) 61 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:01.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:00 smithi062 bash[67442]: cluster 2024-02-22T19:13:59.640373+0000 mgr.x (mgr.34583) 61 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:01.624 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:01 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:01.279+0000 7f808d74e680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-22T19:14:01.624 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:01 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:01.435+0000 7f808d74e680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-22T19:14:01.624 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:01 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:01.524+0000 7f808d74e680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-22T19:14:01.624 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:01 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:01.623+0000 7f808d74e680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-22T19:14:01.906 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:01 smithi062 bash[64101]: audit 2024-02-22T19:14:01.653006+0000 mon.b (mon.2) 152 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-02-22T19:14:01.906 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:01 smithi062 bash[64101]: audit 2024-02-22T19:14:01.653233+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-02-22T19:14:01.907 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:01 smithi062 bash[64101]: audit 2024-02-22T19:14:01.653406+0000 mon.b (mon.2) 154 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-22T19:14:01.907 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:01 smithi062 bash[64101]: audit 2024-02-22T19:14:01.653518+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-02-22T19:14:01.907 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:01 smithi062 bash[64101]: audit 2024-02-22T19:14:01.653589+0000 mon.b (mon.2) 155 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-22T19:14:01.907 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:01 smithi062 bash[64101]: audit 2024-02-22T19:14:01.654144+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-02-22T19:14:01.907 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:01 smithi062 bash[64101]: audit 2024-02-22T19:14:01.654402+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-22T19:14:01.907 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:01 smithi062 bash[64101]: audit 2024-02-22T19:14:01.654641+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-22T19:14:01.907 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:01 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:01.836+0000 7f808d74e680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-22T19:14:01.907 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:01 smithi062 bash[67442]: audit 2024-02-22T19:14:01.653006+0000 mon.b (mon.2) 152 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-02-22T19:14:01.907 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:01 smithi062 bash[67442]: audit 2024-02-22T19:14:01.653233+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-02-22T19:14:01.907 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:01 smithi062 bash[67442]: audit 2024-02-22T19:14:01.653406+0000 mon.b (mon.2) 154 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-22T19:14:01.908 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:01 smithi062 bash[67442]: audit 2024-02-22T19:14:01.653518+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-02-22T19:14:01.908 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:01 smithi062 bash[67442]: audit 2024-02-22T19:14:01.653589+0000 mon.b (mon.2) 155 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-22T19:14:01.908 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:01 smithi062 bash[67442]: audit 2024-02-22T19:14:01.654144+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-02-22T19:14:01.908 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:01 smithi062 bash[67442]: audit 2024-02-22T19:14:01.654402+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-22T19:14:01.908 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:01 smithi062 bash[67442]: audit 2024-02-22T19:14:01.654641+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-22T19:14:02.204 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:01 smithi063 bash[35391]: audit 2024-02-22T19:14:01.653006+0000 mon.b (mon.2) 152 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-02-22T19:14:02.205 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:01 smithi063 bash[35391]: audit 2024-02-22T19:14:01.653233+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-02-22T19:14:02.205 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:01 smithi063 bash[35391]: audit 2024-02-22T19:14:01.653406+0000 mon.b (mon.2) 154 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-22T19:14:02.205 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:01 smithi063 bash[35391]: audit 2024-02-22T19:14:01.653518+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [7, 2]}]: dispatch 2024-02-22T19:14:02.205 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:01 smithi063 bash[35391]: audit 2024-02-22T19:14:01.653589+0000 mon.b (mon.2) 155 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-22T19:14:02.205 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:01 smithi063 bash[35391]: audit 2024-02-22T19:14:01.654144+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-02-22T19:14:02.205 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:01 smithi063 bash[35391]: audit 2024-02-22T19:14:01.654402+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-02-22T19:14:02.205 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:01 smithi063 bash[35391]: audit 2024-02-22T19:14:01.654641+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-22T19:14:02.234 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:02 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:02.136+0000 7f808d74e680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-22T19:14:02.709 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:02 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:02.239+0000 7f808d74e680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-22T19:14:02.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:02 smithi062 bash[64101]: cluster 2024-02-22T19:14:01.640828+0000 mgr.x (mgr.34583) 62 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:02.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:02 smithi062 bash[67442]: cluster 2024-02-22T19:14:01.640828+0000 mgr.x (mgr.34583) 62 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:03.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:02 smithi063 bash[35391]: cluster 2024-02-22T19:14:01.640828+0000 mgr.x (mgr.34583) 62 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:03.424 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:03 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:03.035+0000 7f808d74e680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-22T19:14:03.424 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:03 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:03.122+0000 7f808d74e680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-22T19:14:03.424 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:03 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:03.219+0000 7f808d74e680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-22T19:14:03.980 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:03 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:03.423+0000 7f808d74e680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-22T19:14:03.980 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:03 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:03.693+0000 7f808d74e680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-22T19:14:03.980 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:03 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:03.838+0000 7f808d74e680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-22T19:14:03.981 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[67442]: audit 2024-02-22T19:14:03.402907+0000 mon.b (mon.2) 156 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98387886, \"cpu_percentage\": \"1.92%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.400946Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 62757273, \"cpu_percentage\": \"106.05%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:03.401095Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101533614, \"cpu_percentage\": \"0.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401171Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48528097, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401240Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48307896, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401307Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41984983, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401372Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44543508, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401439Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14522777, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401503Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401567Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 34351349, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401629Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:03.401744Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:14:03.982 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[64101]: audit 2024-02-22T19:14:03.402907+0000 mon.b (mon.2) 156 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98387886, \"cpu_percentage\": \"1.92%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.400946Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 62757273, \"cpu_percentage\": \"106.05%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:03.401095Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101533614, \"cpu_percentage\": \"0.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401171Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48528097, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401240Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48307896, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401307Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41984983, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401372Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44543508, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401439Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14522777, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401503Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401567Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 34351349, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401629Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:03.401744Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:14:03.982 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[67442]: audit 2024-02-22T19:14:03.403586+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98387886, \"cpu_percentage\": \"1.92%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.400946Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 62757273, \"cpu_percentage\": \"106.05%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:03.401095Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101533614, \"cpu_percentage\": \"0.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401171Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48528097, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401240Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48307896, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401307Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41984983, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401372Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44543508, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401439Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14522777, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401503Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401567Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 34351349, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401629Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:03.401744Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:14:03.982 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[64101]: audit 2024-02-22T19:14:03.403586+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98387886, \"cpu_percentage\": \"1.92%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.400946Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 62757273, \"cpu_percentage\": \"106.05%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:03.401095Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101533614, \"cpu_percentage\": \"0.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401171Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48528097, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401240Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48307896, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401307Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41984983, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401372Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44543508, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401439Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14522777, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401503Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401567Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 34351349, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401629Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:03.401744Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:14:03.983 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[67442]: audit 2024-02-22T19:14:03.406440+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98387886, \"cpu_percentage\": \"1.92%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.400946Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 62757273, \"cpu_percentage\": \"106.05%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:03.401095Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101533614, \"cpu_percentage\": \"0.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401171Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48528097, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401240Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48307896, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401307Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41984983, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401372Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44543508, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401439Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14522777, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401503Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401567Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 34351349, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401629Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:03.401744Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:14:03.983 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[64101]: audit 2024-02-22T19:14:03.406440+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98387886, \"cpu_percentage\": \"1.92%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.400946Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 62757273, \"cpu_percentage\": \"106.05%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:03.401095Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101533614, \"cpu_percentage\": \"0.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401171Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48528097, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401240Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48307896, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401307Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41984983, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401372Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44543508, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401439Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14522777, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401503Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401567Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 34351349, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401629Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:03.401744Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:14:03.983 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[67442]: audit 2024-02-22T19:14:03.684124+0000 mon.b (mon.2) 157 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98807316, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682222Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 442499072, \"cpu_percentage\": \"11.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682365Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46818918, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682439Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43819991, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682504Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43442503, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682568Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45980057, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682631Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35032924, \"cpu_percentage\": \"1.16%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682694Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682756Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682817Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33239859, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682877Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:03.682994Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:14:03.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[64101]: audit 2024-02-22T19:14:03.684124+0000 mon.b (mon.2) 157 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98807316, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682222Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 442499072, \"cpu_percentage\": \"11.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682365Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46818918, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682439Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43819991, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682504Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43442503, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682568Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45980057, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682631Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35032924, \"cpu_percentage\": \"1.16%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682694Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682756Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682817Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33239859, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682877Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:03.682994Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:14:03.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[67442]: audit 2024-02-22T19:14:03.684798+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98807316, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682222Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 442499072, \"cpu_percentage\": \"11.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682365Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46818918, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682439Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43819991, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682504Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43442503, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682568Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45980057, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682631Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35032924, \"cpu_percentage\": \"1.16%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682694Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682756Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682817Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33239859, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682877Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:03.682994Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:14:03.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[67442]: audit 2024-02-22T19:14:03.689994+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98807316, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682222Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 442499072, \"cpu_percentage\": \"11.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682365Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46818918, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682439Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43819991, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682504Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43442503, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682568Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45980057, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682631Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35032924, \"cpu_percentage\": \"1.16%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682694Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682756Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682817Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33239859, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682877Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:03.682994Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:14:03.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[67442]: audit 2024-02-22T19:14:03.691546+0000 mon.b (mon.2) 158 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:14:03.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[67442]: audit 2024-02-22T19:14:03.691824+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:14:03.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[67442]: audit 2024-02-22T19:14:03.696760+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-22T19:14:03.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[67442]: audit 2024-02-22T19:14:03.701412+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:03.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[67442]: audit 2024-02-22T19:14:03.702244+0000 mon.b (mon.2) 160 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:14:03.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[67442]: audit 2024-02-22T19:14:03.702551+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:14:03.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[67442]: audit 2024-02-22T19:14:03.705245+0000 mon.b (mon.2) 161 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-22T19:14:03.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[67442]: audit 2024-02-22T19:14:03.705506+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-22T19:14:03.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[67442]: audit 2024-02-22T19:14:03.710498+0000 mon.b (mon.2) 162 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T19:14:03.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[67442]: cluster 2024-02-22T19:14:03.711304+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-22T19:14:03.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[67442]: audit 2024-02-22T19:14:03.712976+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T19:14:03.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[67442]: audit 2024-02-22T19:14:03.713650+0000 mon.b (mon.2) 163 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T19:14:03.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[67442]: audit 2024-02-22T19:14:03.713921+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T19:14:03.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[64101]: audit 2024-02-22T19:14:03.684798+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98807316, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682222Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 442499072, \"cpu_percentage\": \"11.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682365Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46818918, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682439Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43819991, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682504Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43442503, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682568Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45980057, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682631Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35032924, \"cpu_percentage\": \"1.16%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682694Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682756Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682817Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33239859, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682877Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:03.682994Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:14:03.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[64101]: audit 2024-02-22T19:14:03.689994+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98807316, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682222Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 442499072, \"cpu_percentage\": \"11.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682365Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46818918, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682439Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43819991, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682504Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43442503, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682568Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45980057, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682631Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35032924, \"cpu_percentage\": \"1.16%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682694Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682756Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682817Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33239859, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682877Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:03.682994Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:14:03.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[64101]: audit 2024-02-22T19:14:03.691546+0000 mon.b (mon.2) 158 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:14:03.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[64101]: audit 2024-02-22T19:14:03.691824+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:14:03.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[64101]: audit 2024-02-22T19:14:03.696760+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-22T19:14:03.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[64101]: audit 2024-02-22T19:14:03.701412+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:03.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[64101]: audit 2024-02-22T19:14:03.702244+0000 mon.b (mon.2) 160 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:14:03.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[64101]: audit 2024-02-22T19:14:03.702551+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:14:03.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[64101]: audit 2024-02-22T19:14:03.705245+0000 mon.b (mon.2) 161 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-22T19:14:03.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[64101]: audit 2024-02-22T19:14:03.705506+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-22T19:14:03.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[64101]: audit 2024-02-22T19:14:03.710498+0000 mon.b (mon.2) 162 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T19:14:03.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[64101]: cluster 2024-02-22T19:14:03.711304+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-22T19:14:03.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[64101]: audit 2024-02-22T19:14:03.712976+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T19:14:03.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[64101]: audit 2024-02-22T19:14:03.713650+0000 mon.b (mon.2) 163 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T19:14:03.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:03 smithi062 bash[64101]: audit 2024-02-22T19:14:03.713921+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T19:14:04.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:03 smithi063 bash[35391]: audit 2024-02-22T19:14:03.402907+0000 mon.b (mon.2) 156 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98387886, \"cpu_percentage\": \"1.92%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.400946Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 62757273, \"cpu_percentage\": \"106.05%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:03.401095Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101533614, \"cpu_percentage\": \"0.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401171Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48528097, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401240Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48307896, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401307Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41984983, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401372Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44543508, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401439Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14522777, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401503Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401567Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 34351349, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401629Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:03.401744Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:14:04.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:03 smithi063 bash[35391]: audit 2024-02-22T19:14:03.403586+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98387886, \"cpu_percentage\": \"1.92%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.400946Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 62757273, \"cpu_percentage\": \"106.05%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:03.401095Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101533614, \"cpu_percentage\": \"0.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401171Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48528097, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401240Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48307896, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401307Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41984983, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401372Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44543508, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401439Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14522777, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401503Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401567Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 34351349, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401629Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:03.401744Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:14:04.215 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:03 smithi063 bash[35391]: audit 2024-02-22T19:14:03.406440+0000 mon.a (mon.0) 662 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98387886, \"cpu_percentage\": \"1.92%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.400946Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 62757273, \"cpu_percentage\": \"106.05%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:03.401095Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101533614, \"cpu_percentage\": \"0.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401171Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48528097, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401240Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48307896, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401307Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 41984983, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401372Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44543508, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401439Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14522777, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401503Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401567Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 34351349, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.401629Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:03.401744Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:14:04.215 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:03 smithi063 bash[35391]: audit 2024-02-22T19:14:03.684124+0000 mon.b (mon.2) 157 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98807316, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682222Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 442499072, \"cpu_percentage\": \"11.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682365Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46818918, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682439Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43819991, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682504Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43442503, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682568Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45980057, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682631Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35032924, \"cpu_percentage\": \"1.16%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682694Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682756Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682817Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33239859, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682877Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:03.682994Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:14:04.216 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:03 smithi063 bash[35391]: audit 2024-02-22T19:14:03.684798+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98807316, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682222Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 442499072, \"cpu_percentage\": \"11.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682365Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46818918, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682439Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43819991, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682504Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43442503, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682568Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45980057, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682631Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35032924, \"cpu_percentage\": \"1.16%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682694Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682756Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682817Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33239859, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682877Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:03.682994Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-22T19:14:04.216 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:03 smithi063 bash[35391]: audit 2024-02-22T19:14:03.689994+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98807316, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682222Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 442499072, \"cpu_percentage\": \"11.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682365Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46818918, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682439Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43819991, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682504Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43442503, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682568Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45980057, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682631Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35032924, \"cpu_percentage\": \"1.16%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682694Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682756Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682817Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33239859, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682877Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:03.682994Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:03:59.482955Z\", \"last_client_files\": {}}"}]': finished 2024-02-22T19:14:04.216 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:03 smithi063 bash[35391]: audit 2024-02-22T19:14:03.691546+0000 mon.b (mon.2) 158 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:14:04.216 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:03 smithi063 bash[35391]: audit 2024-02-22T19:14:03.691824+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:14:04.216 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:03 smithi063 bash[35391]: audit 2024-02-22T19:14:03.696760+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-22T19:14:04.216 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:03 smithi063 bash[35391]: audit 2024-02-22T19:14:03.701412+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:04.216 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:03 smithi063 bash[35391]: audit 2024-02-22T19:14:03.702244+0000 mon.b (mon.2) 160 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:14:04.216 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:03 smithi063 bash[35391]: audit 2024-02-22T19:14:03.702551+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:14:04.216 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:03 smithi063 bash[35391]: audit 2024-02-22T19:14:03.705245+0000 mon.b (mon.2) 161 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-22T19:14:04.216 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:03 smithi063 bash[35391]: audit 2024-02-22T19:14:03.705506+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-22T19:14:04.216 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:03 smithi063 bash[35391]: audit 2024-02-22T19:14:03.710498+0000 mon.b (mon.2) 162 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T19:14:04.216 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:03 smithi063 bash[35391]: cluster 2024-02-22T19:14:03.711304+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-22T19:14:04.217 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:03 smithi063 bash[35391]: audit 2024-02-22T19:14:03.712976+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T19:14:04.217 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:03 smithi063 bash[35391]: audit 2024-02-22T19:14:03.713650+0000 mon.b (mon.2) 163 : audit [INF] from='mgr.34583 172.21.15.63:0/326022238' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T19:14:04.217 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:03 smithi063 bash[35391]: audit 2024-02-22T19:14:03.713921+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T19:14:04.234 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:03 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:03.979+0000 7f808d74e680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-22T19:14:04.234 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:04.161+0000 7f808d74e680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-22T19:14:04.701 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:04 smithi063 bash[48133]: debug 2024-02-22T19:14:04.699+0000 7f66da7b9700 -1 mgr handle_mgr_map I was active but no longer am 2024-02-22T19:14:04.728 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:04.249+0000 7f808d74e680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-22T19:14:04.958 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:04 smithi063 bash[48133]: ignoring --setuser ceph since I am not root 2024-02-22T19:14:04.958 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:04 smithi063 bash[48133]: ignoring --setgroup ceph since I am not root 2024-02-22T19:14:04.958 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:04 smithi063 bash[48133]: debug 2024-02-22T19:14:04.744+0000 7f82feaaf700 1 -- 172.21.15.63:0/1186299177 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556930c084e0 con 0x556930bdf000 2024-02-22T19:14:04.958 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:04 smithi063 bash[48133]: debug 2024-02-22T19:14:04.873+0000 7f830ec8c680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-22T19:14:04.958 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:04 smithi063 bash[48133]: debug 2024-02-22T19:14:04.957+0000 7f830ec8c680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-22T19:14:04.959 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:04 smithi063 bash[35391]: cluster 2024-02-22T19:14:03.641675+0000 mgr.x (mgr.34583) 63 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:04.959 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:04 smithi063 bash[35391]: cephadm 2024-02-22T19:14:03.703162+0000 mgr.x (mgr.34583) 64 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-22T19:14:04.959 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:04 smithi063 bash[35391]: cephadm 2024-02-22T19:14:03.703487+0000 mgr.x (mgr.34583) 65 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-22T19:14:04.959 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:04 smithi063 bash[35391]: cephadm 2024-02-22T19:14:03.705073+0000 mgr.x (mgr.34583) 66 : cephadm [INF] Failing over to other MGR 2024-02-22T19:14:04.959 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:04 smithi063 bash[35391]: cluster 2024-02-22T19:14:04.263285+0000 mon.a (mon.0) 672 : cluster [INF] Active manager daemon y restarted 2024-02-22T19:14:04.959 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:04 smithi063 bash[35391]: cluster 2024-02-22T19:14:04.263935+0000 mon.a (mon.0) 673 : cluster [INF] Activating manager daemon y 2024-02-22T19:14:04.959 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:04 smithi063 bash[35391]: audit 2024-02-22T19:14:04.264375+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.? 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-22T19:14:04.959 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:04 smithi063 bash[35391]: audit 2024-02-22T19:14:04.267300+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-22T19:14:04.959 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:04 smithi063 bash[35391]: cluster 2024-02-22T19:14:04.267347+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-22T19:14:04.959 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:04 smithi063 bash[35391]: audit 2024-02-22T19:14:04.270998+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.? 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:14:04.959 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:04 smithi063 bash[35391]: audit 2024-02-22T19:14:04.272263+0000 mon.c (mon.1) 21 : audit [DBG] from='mgr.? 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-22T19:14:04.959 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:04 smithi063 bash[35391]: audit 2024-02-22T19:14:04.272534+0000 mon.c (mon.1) 22 : audit [DBG] from='mgr.? 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:14:04.959 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:04 smithi063 bash[35391]: audit 2024-02-22T19:14:04.700218+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-02-22T19:14:04.959 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:04 smithi063 bash[35391]: cluster 2024-02-22T19:14:04.700287+0000 mon.a (mon.0) 677 : cluster [DBG] mgrmap e20: y(active, starting, since 0.436492s) 2024-02-22T19:14:04.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[64101]: cluster 2024-02-22T19:14:03.641675+0000 mgr.x (mgr.34583) 63 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:04.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[64101]: cephadm 2024-02-22T19:14:03.703162+0000 mgr.x (mgr.34583) 64 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-22T19:14:04.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[64101]: cephadm 2024-02-22T19:14:03.703487+0000 mgr.x (mgr.34583) 65 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-22T19:14:04.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[64101]: cephadm 2024-02-22T19:14:03.705073+0000 mgr.x (mgr.34583) 66 : cephadm [INF] Failing over to other MGR 2024-02-22T19:14:04.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[64101]: cluster 2024-02-22T19:14:04.263285+0000 mon.a (mon.0) 672 : cluster [INF] Active manager daemon y restarted 2024-02-22T19:14:04.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[64101]: cluster 2024-02-22T19:14:04.263935+0000 mon.a (mon.0) 673 : cluster [INF] Activating manager daemon y 2024-02-22T19:14:04.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[64101]: audit 2024-02-22T19:14:04.264375+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.? 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-22T19:14:04.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[64101]: audit 2024-02-22T19:14:04.267300+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-22T19:14:04.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[64101]: cluster 2024-02-22T19:14:04.267347+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-22T19:14:04.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[64101]: audit 2024-02-22T19:14:04.270998+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.? 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:14:04.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[64101]: audit 2024-02-22T19:14:04.272263+0000 mon.c (mon.1) 21 : audit [DBG] from='mgr.? 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-22T19:14:04.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[64101]: audit 2024-02-22T19:14:04.272534+0000 mon.c (mon.1) 22 : audit [DBG] from='mgr.? 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:14:04.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[64101]: audit 2024-02-22T19:14:04.700218+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-02-22T19:14:04.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[64101]: cluster 2024-02-22T19:14:04.700287+0000 mon.a (mon.0) 677 : cluster [DBG] mgrmap e20: y(active, starting, since 0.436492s) 2024-02-22T19:14:04.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[67442]: cluster 2024-02-22T19:14:03.641675+0000 mgr.x (mgr.34583) 63 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:04.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[67442]: cephadm 2024-02-22T19:14:03.703162+0000 mgr.x (mgr.34583) 64 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-22T19:14:04.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[67442]: cephadm 2024-02-22T19:14:03.703487+0000 mgr.x (mgr.34583) 65 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-22T19:14:04.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[67442]: cephadm 2024-02-22T19:14:03.705073+0000 mgr.x (mgr.34583) 66 : cephadm [INF] Failing over to other MGR 2024-02-22T19:14:04.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[67442]: cluster 2024-02-22T19:14:04.263285+0000 mon.a (mon.0) 672 : cluster [INF] Active manager daemon y restarted 2024-02-22T19:14:04.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[67442]: cluster 2024-02-22T19:14:04.263935+0000 mon.a (mon.0) 673 : cluster [INF] Activating manager daemon y 2024-02-22T19:14:04.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[67442]: audit 2024-02-22T19:14:04.264375+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.? 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-22T19:14:04.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[67442]: audit 2024-02-22T19:14:04.267300+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-22T19:14:04.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[67442]: cluster 2024-02-22T19:14:04.267347+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-22T19:14:04.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[67442]: audit 2024-02-22T19:14:04.270998+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.? 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:14:04.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[67442]: audit 2024-02-22T19:14:04.272263+0000 mon.c (mon.1) 21 : audit [DBG] from='mgr.? 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-22T19:14:04.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[67442]: audit 2024-02-22T19:14:04.272534+0000 mon.c (mon.1) 22 : audit [DBG] from='mgr.? 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:14:04.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[67442]: audit 2024-02-22T19:14:04.700218+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34583 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-02-22T19:14:04.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:04 smithi062 bash[67442]: cluster 2024-02-22T19:14:04.700287+0000 mon.a (mon.0) 677 : cluster [DBG] mgrmap e20: y(active, starting, since 0.436492s) 2024-02-22T19:14:05.713 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:05 smithi063 bash[48133]: debug 2024-02-22T19:14:05.336+0000 7f830ec8c680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-22T19:14:06.435 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:06 smithi063 bash[48133]: debug 2024-02-22T19:14:06.131+0000 7f830ec8c680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-22T19:14:06.435 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:06 smithi063 bash[48133]: debug 2024-02-22T19:14:06.213+0000 7f830ec8c680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-22T19:14:06.713 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:06 smithi063 bash[48133]: debug 2024-02-22T19:14:06.434+0000 7f830ec8c680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-22T19:14:07.713 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:07 smithi063 bash[48133]: debug 2024-02-22T19:14:07.418+0000 7f830ec8c680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-22T19:14:07.713 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:07 smithi063 bash[48133]: debug 2024-02-22T19:14:07.555+0000 7f830ec8c680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-22T19:14:07.714 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:07 smithi063 bash[48133]: debug 2024-02-22T19:14:07.637+0000 7f830ec8c680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-22T19:14:08.213 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:07 smithi063 bash[48133]: debug 2024-02-22T19:14:07.731+0000 7f830ec8c680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-22T19:14:08.213 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:07 smithi063 bash[48133]: debug 2024-02-22T19:14:07.933+0000 7f830ec8c680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-22T19:14:08.713 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:08 smithi063 bash[48133]: debug 2024-02-22T19:14:08.228+0000 7f830ec8c680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-22T19:14:08.713 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:08 smithi063 bash[48133]: debug 2024-02-22T19:14:08.330+0000 7f830ec8c680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-22T19:14:09.453 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:09 smithi063 bash[48133]: debug 2024-02-22T19:14:09.089+0000 7f830ec8c680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-22T19:14:09.453 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:09 smithi063 bash[48133]: debug 2024-02-22T19:14:09.175+0000 7f830ec8c680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-22T19:14:09.453 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:09 smithi063 bash[48133]: debug 2024-02-22T19:14:09.271+0000 7f830ec8c680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-22T19:14:09.454 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:09 smithi063 bash[48133]: debug 2024-02-22T19:14:09.452+0000 7f830ec8c680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-22T19:14:09.997 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:09 smithi063 bash[48133]: debug 2024-02-22T19:14:09.719+0000 7f830ec8c680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-22T19:14:09.998 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:09 smithi063 bash[48133]: debug 2024-02-22T19:14:09.857+0000 7f830ec8c680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-22T19:14:10.266 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:09 smithi063 bash[48133]: debug 2024-02-22T19:14:09.996+0000 7f830ec8c680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-22T19:14:10.266 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:10 smithi063 bash[48133]: debug 2024-02-22T19:14:10.177+0000 7f830ec8c680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-22T19:14:10.713 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:10 smithi063 bash[48133]: debug 2024-02-22T19:14:10.265+0000 7f830ec8c680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-22T19:14:10.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:10 smithi063 bash[35391]: cluster 2024-02-22T19:14:10.280726+0000 mon.a (mon.0) 678 : cluster [DBG] Standby manager daemon x started 2024-02-22T19:14:10.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:10 smithi063 bash[35391]: audit 2024-02-22T19:14:10.280826+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.? 172.21.15.63:0/645822493' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T19:14:10.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:10 smithi063 bash[35391]: audit 2024-02-22T19:14:10.281265+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.? 172.21.15.63:0/645822493' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:14:10.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:10 smithi063 bash[35391]: audit 2024-02-22T19:14:10.282336+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.? 172.21.15.63:0/645822493' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T19:14:10.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:10 smithi063 bash[35391]: audit 2024-02-22T19:14:10.282692+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.? 172.21.15.63:0/645822493' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:14:10.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:10 smithi062 bash[64101]: cluster 2024-02-22T19:14:10.280726+0000 mon.a (mon.0) 678 : cluster [DBG] Standby manager daemon x started 2024-02-22T19:14:10.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:10 smithi062 bash[64101]: audit 2024-02-22T19:14:10.280826+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.? 172.21.15.63:0/645822493' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T19:14:10.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:10 smithi062 bash[64101]: audit 2024-02-22T19:14:10.281265+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.? 172.21.15.63:0/645822493' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:14:10.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:10 smithi062 bash[64101]: audit 2024-02-22T19:14:10.282336+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.? 172.21.15.63:0/645822493' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T19:14:10.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:10 smithi062 bash[64101]: audit 2024-02-22T19:14:10.282692+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.? 172.21.15.63:0/645822493' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:14:10.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:10 smithi062 bash[67442]: cluster 2024-02-22T19:14:10.280726+0000 mon.a (mon.0) 678 : cluster [DBG] Standby manager daemon x started 2024-02-22T19:14:10.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:10 smithi062 bash[67442]: audit 2024-02-22T19:14:10.280826+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.? 172.21.15.63:0/645822493' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T19:14:10.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:10 smithi062 bash[67442]: audit 2024-02-22T19:14:10.281265+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.? 172.21.15.63:0/645822493' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:14:10.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:10 smithi062 bash[67442]: audit 2024-02-22T19:14:10.282336+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.? 172.21.15.63:0/645822493' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T19:14:10.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:10 smithi062 bash[67442]: audit 2024-02-22T19:14:10.282692+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.? 172.21.15.63:0/645822493' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:14:11.234 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:10 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: [79B blob data] 2024-02-22T19:14:11.234 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:10 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: [79B blob data] 2024-02-22T19:14:11.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.339133+0000 mon.c (mon.1) 27 : audit [DBG] from='mgr.? 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T19:14:11.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.339248+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.? 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T19:14:11.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: cluster 2024-02-22T19:14:10.339609+0000 mon.a (mon.0) 679 : cluster [DBG] mgrmap e21: y(active, starting, since 6s), standbys: x 2024-02-22T19:14:11.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.702008+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T19:14:11.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.702277+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T19:14:11.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.702510+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T19:14:11.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.704229+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:14:11.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.704574+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:14:11.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.704877+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:14:11.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.705168+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:14:11.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.705434+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:14:11.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.705741+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:14:11.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.706096+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:14:11.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.706312+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:14:11.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.706688+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T19:14:11.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.706921+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T19:14:11.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.707435+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T19:14:11.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.708377+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T19:14:11.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.709301+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-22T19:14:11.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.709717+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T19:14:11.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.710118+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T19:14:11.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.710506+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi062"}]: dispatch 2024-02-22T19:14:11.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.710947+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi063"}]: dispatch 2024-02-22T19:14:11.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.711352+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T19:14:11.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.711741+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-22T19:14:11.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.712093+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T19:14:11.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.712489+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T19:14:11.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.712896+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T19:14:11.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.713275+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T19:14:11.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.713654+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T19:14:11.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.714037+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T19:14:11.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.714396+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T19:14:11.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.714808+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T19:14:11.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.715165+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-22T19:14:11.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.715516+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T19:14:11.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.715878+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:14:11.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.716259+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:14:11.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.716630+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T19:14:11.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.717018+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T19:14:11.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.717360+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T19:14:11.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.717720+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T19:14:11.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: cluster 2024-02-22T19:14:10.733135+0000 mon.a (mon.0) 680 : cluster [INF] Manager daemon y is now available 2024-02-22T19:14:11.718 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.747529+0000 mon.c (mon.1) 67 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"172.21.15.62\", \"labels\": [], \"status\": \"\"}, \"smithi063\": {\"hostname\": \"smithi063\", \"addr\": \"172.21.15.63\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-22T19:14:11.718 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.747958+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"172.21.15.62\", \"labels\": [], \"status\": \"\"}, \"smithi063\": {\"hostname\": \"smithi063\", \"addr\": \"172.21.15.63\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-22T19:14:11.718 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.751277+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"172.21.15.62\", \"labels\": [], \"status\": \"\"}, \"smithi063\": {\"hostname\": \"smithi063\", \"addr\": \"172.21.15.63\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-22T19:14:11.718 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.851379+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:11.718 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.852875+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:11.718 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.894651+0000 mon.c (mon.1) 70 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:14:11.718 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.894933+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:14:11.718 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.899858+0000 mon.c (mon.1) 71 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T19:14:11.718 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:10.900451+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T19:14:11.718 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:11.062671+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:14:11.718 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:11.317701+0000 mon.c (mon.1) 73 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98807316, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682222Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 442499072, \"cpu_percentage\": \"11.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682365Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46818918, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682439Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43819991, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682504Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43442503, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682568Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45980057, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682631Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35032924, \"cpu_percentage\": \"1.16%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682694Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682756Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682817Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33239859, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682877Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:11.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:11.318226+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98807316, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682222Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 442499072, \"cpu_percentage\": \"11.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682365Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46818918, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682439Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43819991, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682504Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43442503, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682568Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45980057, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682631Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35032924, \"cpu_percentage\": \"1.16%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682694Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682756Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682817Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33239859, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682877Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:11.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:11.321377+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98807316, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682222Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 442499072, \"cpu_percentage\": \"11.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682365Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46818918, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682439Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43819991, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682504Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43442503, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682568Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45980057, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682631Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35032924, \"cpu_percentage\": \"1.16%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682694Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682756Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682817Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33239859, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682877Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:14:11.719 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:11 smithi063 bash[35391]: audit 2024-02-22T19:14:11.322574+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:14:11.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.339133+0000 mon.c (mon.1) 27 : audit [DBG] from='mgr.? 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T19:14:11.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.339248+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.? 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T19:14:11.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: cluster 2024-02-22T19:14:10.339609+0000 mon.a (mon.0) 679 : cluster [DBG] mgrmap e21: y(active, starting, since 6s), standbys: x 2024-02-22T19:14:11.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.702008+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T19:14:11.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.702277+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T19:14:11.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.702510+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T19:14:11.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.704229+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:14:11.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.704574+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:14:11.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.704877+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:14:11.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.705168+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:14:11.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.705434+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:14:11.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.705741+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:14:11.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.706096+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:14:11.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.706312+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:14:11.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.706688+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T19:14:11.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.706921+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T19:14:11.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.707435+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T19:14:11.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.708377+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T19:14:11.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.339133+0000 mon.c (mon.1) 27 : audit [DBG] from='mgr.? 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T19:14:11.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.339248+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.? 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T19:14:11.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: cluster 2024-02-22T19:14:10.339609+0000 mon.a (mon.0) 679 : cluster [DBG] mgrmap e21: y(active, starting, since 6s), standbys: x 2024-02-22T19:14:11.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.702008+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T19:14:11.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.702277+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T19:14:11.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.702510+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T19:14:11.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.704229+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:14:11.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.704574+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:14:11.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.704877+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:14:11.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.705168+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:14:11.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.705434+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:14:11.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.705741+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:14:11.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.706096+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:14:11.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.706312+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:14:11.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.706688+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T19:14:11.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.706921+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T19:14:11.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.707435+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T19:14:11.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.708377+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T19:14:11.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.709301+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-22T19:14:11.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.709717+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T19:14:11.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.710118+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T19:14:11.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.710506+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi062"}]: dispatch 2024-02-22T19:14:11.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.710947+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi063"}]: dispatch 2024-02-22T19:14:11.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.711352+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T19:14:11.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.711741+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-22T19:14:11.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.712093+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T19:14:11.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.712489+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T19:14:11.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.712896+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T19:14:11.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.713275+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T19:14:11.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.713654+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T19:14:11.739 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.714037+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T19:14:11.739 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.714396+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T19:14:11.739 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.714808+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T19:14:11.739 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.715165+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-22T19:14:11.739 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.715516+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T19:14:11.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.709301+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-22T19:14:11.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.709717+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T19:14:11.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.710118+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T19:14:11.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.710506+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi062"}]: dispatch 2024-02-22T19:14:11.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.710947+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi063"}]: dispatch 2024-02-22T19:14:11.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.711352+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T19:14:11.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.711741+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-22T19:14:11.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.712093+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T19:14:11.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.712489+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T19:14:11.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.712896+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T19:14:11.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.713275+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T19:14:11.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.713654+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T19:14:11.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.714037+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T19:14:11.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.714396+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T19:14:11.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.714808+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T19:14:11.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.715165+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-22T19:14:11.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.715516+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T19:14:11.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.715878+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:14:11.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.716259+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:14:11.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.716630+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T19:14:11.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.717018+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T19:14:11.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.717360+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T19:14:11.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.717720+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T19:14:11.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: cluster 2024-02-22T19:14:10.733135+0000 mon.a (mon.0) 680 : cluster [INF] Manager daemon y is now available 2024-02-22T19:14:11.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.747529+0000 mon.c (mon.1) 67 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"172.21.15.62\", \"labels\": [], \"status\": \"\"}, \"smithi063\": {\"hostname\": \"smithi063\", \"addr\": \"172.21.15.63\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-22T19:14:11.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.747958+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"172.21.15.62\", \"labels\": [], \"status\": \"\"}, \"smithi063\": {\"hostname\": \"smithi063\", \"addr\": \"172.21.15.63\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-22T19:14:11.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.751277+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"172.21.15.62\", \"labels\": [], \"status\": \"\"}, \"smithi063\": {\"hostname\": \"smithi063\", \"addr\": \"172.21.15.63\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-22T19:14:11.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.851379+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:11.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.852875+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:11.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.894651+0000 mon.c (mon.1) 70 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:14:11.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.894933+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:14:11.742 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.899858+0000 mon.c (mon.1) 71 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T19:14:11.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.715878+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:14:11.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.716259+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:14:11.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.716630+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T19:14:11.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.717018+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T19:14:11.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.717360+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T19:14:11.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.717720+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T19:14:11.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: cluster 2024-02-22T19:14:10.733135+0000 mon.a (mon.0) 680 : cluster [INF] Manager daemon y is now available 2024-02-22T19:14:11.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.747529+0000 mon.c (mon.1) 67 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"172.21.15.62\", \"labels\": [], \"status\": \"\"}, \"smithi063\": {\"hostname\": \"smithi063\", \"addr\": \"172.21.15.63\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-22T19:14:11.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.747958+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"172.21.15.62\", \"labels\": [], \"status\": \"\"}, \"smithi063\": {\"hostname\": \"smithi063\", \"addr\": \"172.21.15.63\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-22T19:14:11.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.751277+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi062\": {\"hostname\": \"smithi062\", \"addr\": \"172.21.15.62\", \"labels\": [], \"status\": \"\"}, \"smithi063\": {\"hostname\": \"smithi063\", \"addr\": \"172.21.15.63\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-22T19:14:11.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.851379+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:11.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.852875+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:11.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.894651+0000 mon.c (mon.1) 70 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:14:11.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.894933+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:14:11.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.899858+0000 mon.c (mon.1) 71 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T19:14:11.743 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:10.900451+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T19:14:11.743 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:11.062671+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:14:11.744 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:10.900451+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T19:14:11.744 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:11.062671+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:14:11.744 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:11.317701+0000 mon.c (mon.1) 73 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98807316, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682222Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 442499072, \"cpu_percentage\": \"11.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682365Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46818918, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682439Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43819991, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682504Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43442503, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682568Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45980057, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682631Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35032924, \"cpu_percentage\": \"1.16%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682694Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682756Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682817Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33239859, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682877Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:11.744 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:11.317701+0000 mon.c (mon.1) 73 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98807316, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682222Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 442499072, \"cpu_percentage\": \"11.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682365Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46818918, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682439Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43819991, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682504Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43442503, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682568Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45980057, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682631Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35032924, \"cpu_percentage\": \"1.16%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682694Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682756Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682817Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33239859, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682877Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:11.745 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:11.318226+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98807316, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682222Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 442499072, \"cpu_percentage\": \"11.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682365Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46818918, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682439Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43819991, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682504Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43442503, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682568Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45980057, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682631Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35032924, \"cpu_percentage\": \"1.16%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682694Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682756Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682817Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33239859, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682877Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:11.745 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:11.321377+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98807316, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682222Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 442499072, \"cpu_percentage\": \"11.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682365Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46818918, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682439Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43819991, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682504Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43442503, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682568Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45980057, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682631Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35032924, \"cpu_percentage\": \"1.16%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682694Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682756Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682817Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33239859, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682877Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:14:11.745 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[64101]: audit 2024-02-22T19:14:11.322574+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:14:11.746 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:11.318226+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98807316, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682222Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 442499072, \"cpu_percentage\": \"11.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682365Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46818918, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682439Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43819991, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682504Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43442503, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682568Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45980057, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682631Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35032924, \"cpu_percentage\": \"1.16%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682694Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682756Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682817Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33239859, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682877Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:11.746 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:11.321377+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 98807316, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682222Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 442499072, \"cpu_percentage\": \"11.64%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682365Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46818918, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682439Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43819991, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682504Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43442503, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682568Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45980057, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682631Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35032924, \"cpu_percentage\": \"1.16%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682694Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682756Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682817Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 33239859, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:03.682877Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:14:11.746 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:11 smithi062 bash[67442]: audit 2024-02-22T19:14:11.322574+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:14:12.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:12 smithi063 bash[35391]: cephadm 2024-02-22T19:14:10.746989+0000 mgr.y (mgr.24811) 1 : cephadm [INF] inventory: adjusted host smithi063 addr 'smithi063' -> '172.21.15.63' 2024-02-22T19:14:12.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:12 smithi063 bash[35391]: cluster 2024-02-22T19:14:11.572241+0000 mon.a (mon.0) 687 : cluster [DBG] mgrmap e22: y(active, since 7s), standbys: x 2024-02-22T19:14:12.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:12 smithi062 bash[64101]: cephadm 2024-02-22T19:14:10.746989+0000 mgr.y (mgr.24811) 1 : cephadm [INF] inventory: adjusted host smithi063 addr 'smithi063' -> '172.21.15.63' 2024-02-22T19:14:12.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:12 smithi062 bash[64101]: cluster 2024-02-22T19:14:11.572241+0000 mon.a (mon.0) 687 : cluster [DBG] mgrmap e22: y(active, since 7s), standbys: x 2024-02-22T19:14:12.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:12 smithi062 bash[67442]: cephadm 2024-02-22T19:14:10.746989+0000 mgr.y (mgr.24811) 1 : cephadm [INF] inventory: adjusted host smithi063 addr 'smithi063' -> '172.21.15.63' 2024-02-22T19:14:12.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:12 smithi062 bash[67442]: cluster 2024-02-22T19:14:11.572241+0000 mon.a (mon.0) 687 : cluster [DBG] mgrmap e22: y(active, since 7s), standbys: x 2024-02-22T19:14:13.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:13 smithi063 bash[35391]: cluster 2024-02-22T19:14:11.584372+0000 mgr.y (mgr.24811) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:13.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:13 smithi063 bash[35391]: cluster 2024-02-22T19:14:12.574980+0000 mon.a (mon.0) 688 : cluster [DBG] mgrmap e23: y(active, since 8s), standbys: x 2024-02-22T19:14:13.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:13 smithi062 bash[64101]: cluster 2024-02-22T19:14:11.584372+0000 mgr.y (mgr.24811) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:13.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:13 smithi062 bash[64101]: cluster 2024-02-22T19:14:12.574980+0000 mon.a (mon.0) 688 : cluster [DBG] mgrmap e23: y(active, since 8s), standbys: x 2024-02-22T19:14:13.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:13 smithi062 bash[67442]: cluster 2024-02-22T19:14:11.584372+0000 mgr.y (mgr.24811) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:13.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:13 smithi062 bash[67442]: cluster 2024-02-22T19:14:12.574980+0000 mon.a (mon.0) 688 : cluster [DBG] mgrmap e23: y(active, since 8s), standbys: x 2024-02-22T19:14:14.521 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:14 smithi063 bash[35391]: cluster 2024-02-22T19:14:12.705935+0000 mgr.y (mgr.24811) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:14.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:14 smithi062 bash[64101]: cluster 2024-02-22T19:14:12.705935+0000 mgr.y (mgr.24811) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:14.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:14 smithi062 bash[67442]: cluster 2024-02-22T19:14:12.705935+0000 mgr.y (mgr.24811) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:15.584 INFO:teuthology.orchestra.run.smithi062.stdout:true 2024-02-22T19:14:16.220 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T19:14:16.220 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.a smithi062 running (46s) 0s ago 6m 16.5M - 0.26.0 9f27df16978d 61d969d05cbc 2024-02-22T19:14:16.220 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.a smithi063 running (5m) 12s ago 5m 30.0M - 6.6.2 87a51ecf0b1c 9863e2980fa6 2024-02-22T19:14:16.220 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.x smithi063 running (87s) 12s ago 9m 422M - 16.2.14-550-geb66ed92 7403d1862307 c7743467a258 2024-02-22T19:14:16.221 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.y smithi062 *:8443 running (18s) 0s ago 11m 405M - 16.2.14-550-geb66ed92 7403d1862307 0310c48cbf40 2024-02-22T19:14:16.221 INFO:teuthology.orchestra.run.smithi062.stdout:mon.a smithi062 running (11m) 0s ago 11m 96.4M 2048M 15.2.0 204a01f9b0b6 edca537a955b 2024-02-22T19:14:16.221 INFO:teuthology.orchestra.run.smithi062.stdout:mon.b smithi063 running (9m) 12s ago 9m 94.2M 2048M 15.2.0 204a01f9b0b6 deb740d884ca 2024-02-22T19:14:16.221 INFO:teuthology.orchestra.run.smithi062.stdout:mon.c smithi062 running (10m) 0s ago 10m 98.0M 2048M 15.2.0 204a01f9b0b6 921b06886416 2024-02-22T19:14:16.221 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.a smithi062 running (6m) 0s ago 6m 13.2M - 1.7.0 72c9c2088986 3e27c560bf7f 2024-02-22T19:14:16.221 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.b smithi063 running (6m) 12s ago 6m 13.0M - 1.7.0 72c9c2088986 ab2867e3fd57 2024-02-22T19:14:16.221 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (9m) 0s ago 9m 46.5M 4096M 15.2.0 204a01f9b0b6 e651beecc87d 2024-02-22T19:14:16.221 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (8m) 0s ago 8m 46.3M 4096M 15.2.0 204a01f9b0b6 d7a667155c4b 2024-02-22T19:14:16.221 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (8m) 0s ago 8m 40.3M 4096M 15.2.0 204a01f9b0b6 dc5ec198f96d 2024-02-22T19:14:16.221 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi062 running (8m) 0s ago 8m 42.7M 4096M 15.2.0 204a01f9b0b6 efb44063d52f 2024-02-22T19:14:16.221 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi063 running (7m) 12s ago 7m 44.6M 4096M 15.2.0 204a01f9b0b6 0affbe803c22 2024-02-22T19:14:16.222 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi063 running (7m) 12s ago 7m 41.7M 4096M 15.2.0 204a01f9b0b6 636665ed6108 2024-02-22T19:14:16.222 INFO:teuthology.orchestra.run.smithi062.stdout:osd.6 smithi063 running (7m) 12s ago 7m 41.4M 4096M 15.2.0 204a01f9b0b6 8c48e05bc7dd 2024-02-22T19:14:16.222 INFO:teuthology.orchestra.run.smithi062.stdout:osd.7 smithi063 running (6m) 12s ago 6m 43.8M 4096M 15.2.0 204a01f9b0b6 c298ad18c8bb 2024-02-22T19:14:16.222 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.a smithi063 running (35s) 12s ago 6m 33.4M - 2.50.0 38c53d8da784 564ec2e44075 2024-02-22T19:14:16.222 INFO:teuthology.orchestra.run.smithi062.stdout:rgw.r.z.smithi062.zxmpna smithi062 running (4m) 0s ago 4m 33.5M - 15.2.0 204a01f9b0b6 45553891c2c4 2024-02-22T19:14:16.222 INFO:teuthology.orchestra.run.smithi062.stdout:rgw.r.z.smithi063.feyald smithi063 running (4m) 12s ago 4m 31.7M - 15.2.0 204a01f9b0b6 478364f15ee3 2024-02-22T19:14:16.609 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-22T19:14:16.609 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-02-22T19:14:16.609 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-22T19:14:16.609 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:14:16.609 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-02-22T19:14:16.610 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T19:14:16.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:14:16.610 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-02-22T19:14:16.610 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-22T19:14:16.610 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:14:16.610 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": {}, 2024-02-22T19:14:16.610 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw": { 2024-02-22T19:14:16.610 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-22T19:14:16.611 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:14:16.611 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-02-22T19:14:16.611 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 13, 2024-02-22T19:14:16.611 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T19:14:16.611 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-02-22T19:14:16.611 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-22T19:14:16.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: cluster 2024-02-22T19:14:14.706319+0000 mgr.y (mgr.24811) 4 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:16.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:15.427449+0000 mon.c (mon.1) 75 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101124669, \"cpu_percentage\": \"1.93%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424017Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 425197568, \"cpu_percentage\": \"54.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:15.424285Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102770933, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424431Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48769269, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424576Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48570040, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424719Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42289070, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424862Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44868567, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425002Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13914603, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425135Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425277Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35190210, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425406Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:15.425625Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:16.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:15.427984+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101124669, \"cpu_percentage\": \"1.93%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424017Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 425197568, \"cpu_percentage\": \"54.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:15.424285Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102770933, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424431Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48769269, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424576Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48570040, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424719Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42289070, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424862Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44868567, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425002Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13914603, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425135Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425277Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35190210, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425406Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:15.425625Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:16.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:15.431429+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101124669, \"cpu_percentage\": \"1.93%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424017Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 425197568, \"cpu_percentage\": \"54.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:15.424285Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102770933, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424431Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48769269, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424576Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48570040, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424719Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42289070, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424862Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44868567, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425002Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13914603, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425135Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425277Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35190210, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425406Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:15.425625Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:14:16.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:15.740170+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:16.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:15.740584+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:15.740923+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:16.715 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:15.741231+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:15.741536+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:16.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:15.741851+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:15.742152+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:16.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:15.742444+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:15.742760+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:16.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:16.210333+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:14:16.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:16.210730+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:14:16.716 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:16.211026+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:16.211335+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:16.211647+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:16.211948+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:16.213559+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:14:16.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:16.213866+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:16.214172+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:16.214470+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.717 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:16 smithi063 bash[35391]: audit 2024-02-22T19:14:16.214779+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: cluster 2024-02-22T19:14:14.706319+0000 mgr.y (mgr.24811) 4 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:16.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: cluster 2024-02-22T19:14:14.706319+0000 mgr.y (mgr.24811) 4 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:16.736 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:15.427449+0000 mon.c (mon.1) 75 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101124669, \"cpu_percentage\": \"1.93%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424017Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 425197568, \"cpu_percentage\": \"54.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:15.424285Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102770933, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424431Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48769269, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424576Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48570040, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424719Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42289070, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424862Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44868567, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425002Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13914603, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425135Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425277Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35190210, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425406Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:15.425625Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:16.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:15.427449+0000 mon.c (mon.1) 75 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101124669, \"cpu_percentage\": \"1.93%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424017Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 425197568, \"cpu_percentage\": \"54.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:15.424285Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102770933, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424431Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48769269, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424576Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48570040, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424719Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42289070, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424862Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44868567, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425002Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13914603, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425135Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425277Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35190210, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425406Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:15.425625Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:16.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:15.427984+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101124669, \"cpu_percentage\": \"1.93%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424017Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 425197568, \"cpu_percentage\": \"54.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:15.424285Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102770933, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424431Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48769269, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424576Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48570040, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424719Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42289070, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424862Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44868567, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425002Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13914603, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425135Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425277Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35190210, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425406Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:15.425625Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:16.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:15.431429+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101124669, \"cpu_percentage\": \"1.93%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424017Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 425197568, \"cpu_percentage\": \"54.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:15.424285Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102770933, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424431Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48769269, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424576Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48570040, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424719Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42289070, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424862Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44868567, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425002Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13914603, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425135Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425277Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35190210, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425406Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:15.425625Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:14:16.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:15.740170+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:16.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:15.740584+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:15.740923+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:16.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:15.741231+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:15.741536+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:16.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:15.741851+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:15.742152+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:16.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:15.742444+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:15.742760+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:16.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:16.210333+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:14:16.738 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:16.210730+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:14:16.739 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:16.211026+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.739 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:16.211335+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.739 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:16.211647+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.739 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:16.211948+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.739 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:16.213559+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:14:16.739 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:16.213866+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.739 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:16.214172+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.739 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:16.214470+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.739 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[64101]: audit 2024-02-22T19:14:16.214779+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:15.427984+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101124669, \"cpu_percentage\": \"1.93%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424017Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 425197568, \"cpu_percentage\": \"54.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:15.424285Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102770933, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424431Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48769269, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424576Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48570040, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424719Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42289070, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424862Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44868567, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425002Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13914603, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425135Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425277Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35190210, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425406Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:15.425625Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:16.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:15.431429+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"container_id\": \"edca537a955b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 101124669, \"cpu_percentage\": \"1.93%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424017Z\", \"created\": \"2024-02-22T19:02:43.425956Z\", \"started\": \"2024-02-22T19:02:48.798298Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 425197568, \"cpu_percentage\": \"54.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:15.424285Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102770933, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424431Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48769269, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424576Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48570040, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424719Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42289070, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424862Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44868567, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425002Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13914603, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425135Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425277Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35190210, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425406Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:18.530714Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:15.425625Z\", \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:14:16.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:15.740170+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:16.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:15.740584+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:15.740923+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:16.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:15.741231+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:15.741536+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:16.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:15.741851+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:15.742152+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:16.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:15.742444+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:15.742760+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:16.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:16.210333+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:14:16.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:16.210730+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:14:16.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:16.211026+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:16.211335+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:16.211647+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:16.211948+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:16.213559+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:14:16.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:16.213866+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:16.214172+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:16.214470+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[67442]: audit 2024-02-22T19:14:16.214779+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:16.932 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-22T19:14:16.932 INFO:teuthology.orchestra.run.smithi062.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", 2024-02-22T19:14:16.933 INFO:teuthology.orchestra.run.smithi062.stdout: "in_progress": true, 2024-02-22T19:14:16.933 INFO:teuthology.orchestra.run.smithi062.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-22T19:14:16.933 INFO:teuthology.orchestra.run.smithi062.stdout: "services_complete": [ 2024-02-22T19:14:16.933 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr" 2024-02-22T19:14:16.933 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-02-22T19:14:16.933 INFO:teuthology.orchestra.run.smithi062.stdout: "progress": "2/20 daemons upgraded", 2024-02-22T19:14:16.933 INFO:teuthology.orchestra.run.smithi062.stdout: "message": "Currently upgrading mgr daemons", 2024-02-22T19:14:16.933 INFO:teuthology.orchestra.run.smithi062.stdout: "is_paused": false 2024-02-22T19:14:16.933 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-22T19:14:17.234 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:14:16 smithi062 bash[86519]: ts=2024-02-22T19:14:16.952Z caller=notify.go:745 level=warn component=dispatcher receiver=web.hook integration=webhook[0] aggrGroup="{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 127.0.0.1:5001: connect: connection refused" 2024-02-22T19:14:17.646 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:15.572197+0000 mgr.y (mgr.24811) 5 : audit [DBG] from='client.24835 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:14:17.646 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:15.899002+0000 mgr.y (mgr.24811) 6 : audit [DBG] from='client.24841 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:14:17.646 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:16.208421+0000 mgr.y (mgr.24811) 7 : audit [DBG] from='client.24847 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:14:17.646 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:16.571374+0000 mon.c (mon.1) 96 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100600381, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568512Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 399297740, \"cpu_percentage\": \"17.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568734Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568852Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44113592, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569003Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43809505, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569154Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46284144, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569301Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35043409, \"cpu_percentage\": \"0.90%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569454Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13641973, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569590Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569721Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 33732689, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569842Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:16.570092Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:17.647 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:16.571976+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100600381, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568512Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 399297740, \"cpu_percentage\": \"17.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568734Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568852Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44113592, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569003Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43809505, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569154Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46284144, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569301Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35043409, \"cpu_percentage\": \"0.90%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569454Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13641973, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569590Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569721Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 33732689, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569842Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:16.570092Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:17.647 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:16.576106+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100600381, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568512Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 399297740, \"cpu_percentage\": \"17.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568734Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568852Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44113592, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569003Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43809505, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569154Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46284144, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569301Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35043409, \"cpu_percentage\": \"0.90%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569454Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13641973, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569590Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569721Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 33732689, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569842Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:16.570092Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:14:17.647 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:16.608916+0000 mon.c (mon.1) 97 : audit [DBG] from='client.? 172.21.15.62:0/2728268786' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:14:17.647 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:16.869169+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:17.647 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:16.869593+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:17.647 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:16.869944+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:17.647 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:16.870265+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:17.647 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:16.870618+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:17.647 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:16.870945+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:17.648 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:16.871263+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:17.648 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:16.871566+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:17.648 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:16.871871+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:17.648 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:16.873425+0000 mon.c (mon.1) 107 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:14:17.648 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:16.873675+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:14:17.648 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:16.877592+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-22T19:14:17.648 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:16.883835+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:17.648 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:16.884714+0000 mon.c (mon.1) 109 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:14:17.648 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:17 smithi063 bash[35391]: audit 2024-02-22T19:14:16.884955+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:14:17.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:15.572197+0000 mgr.y (mgr.24811) 5 : audit [DBG] from='client.24835 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:14:17.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:15.899002+0000 mgr.y (mgr.24811) 6 : audit [DBG] from='client.24841 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:14:17.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:16.208421+0000 mgr.y (mgr.24811) 7 : audit [DBG] from='client.24847 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:14:17.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:15.572197+0000 mgr.y (mgr.24811) 5 : audit [DBG] from='client.24835 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:14:17.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:15.899002+0000 mgr.y (mgr.24811) 6 : audit [DBG] from='client.24841 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:14:17.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:16.208421+0000 mgr.y (mgr.24811) 7 : audit [DBG] from='client.24847 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:14:17.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:16.571374+0000 mon.c (mon.1) 96 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100600381, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568512Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 399297740, \"cpu_percentage\": \"17.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568734Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568852Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44113592, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569003Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43809505, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569154Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46284144, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569301Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35043409, \"cpu_percentage\": \"0.90%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569454Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13641973, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569590Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569721Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 33732689, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569842Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:16.570092Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:17.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:16.571374+0000 mon.c (mon.1) 96 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100600381, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568512Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 399297740, \"cpu_percentage\": \"17.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568734Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568852Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44113592, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569003Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43809505, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569154Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46284144, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569301Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35043409, \"cpu_percentage\": \"0.90%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569454Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13641973, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569590Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569721Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 33732689, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569842Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:16.570092Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:17.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:16.571976+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100600381, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568512Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 399297740, \"cpu_percentage\": \"17.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568734Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568852Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44113592, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569003Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43809505, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569154Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46284144, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569301Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35043409, \"cpu_percentage\": \"0.90%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569454Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13641973, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569590Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569721Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 33732689, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569842Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:16.570092Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:17.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:16.576106+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100600381, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568512Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 399297740, \"cpu_percentage\": \"17.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568734Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568852Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44113592, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569003Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43809505, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569154Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46284144, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569301Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35043409, \"cpu_percentage\": \"0.90%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569454Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13641973, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569590Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569721Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 33732689, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569842Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:16.570092Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:14:17.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:16.608916+0000 mon.c (mon.1) 97 : audit [DBG] from='client.? 172.21.15.62:0/2728268786' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:14:17.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:16.869169+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:17.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:16.869593+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:17.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:16.869944+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:17.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:16.870265+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:17.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:16.870618+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:17.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:16.870945+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:17.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:16.871263+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:17.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:16.871566+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:17.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:16.871871+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:17.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:16.873425+0000 mon.c (mon.1) 107 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:14:17.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:16.873675+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:14:17.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:16.877592+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-22T19:14:17.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:16.883835+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:17.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:16.884714+0000 mon.c (mon.1) 109 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:14:17.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[67442]: audit 2024-02-22T19:14:16.884955+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:14:17.740 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:16.571976+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100600381, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568512Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 399297740, \"cpu_percentage\": \"17.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568734Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568852Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44113592, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569003Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43809505, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569154Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46284144, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569301Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35043409, \"cpu_percentage\": \"0.90%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569454Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13641973, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569590Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569721Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 33732689, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569842Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:16.570092Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:17.740 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:16.576106+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100600381, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568512Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"c7743467a258\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:eb66ed921e744301e6863be6353618d63967ea59\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 399297740, \"cpu_percentage\": \"17.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568734Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:12:48.584846Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568852Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44113592, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569003Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43809505, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569154Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46284144, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569301Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35043409, \"cpu_percentage\": \"0.90%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569454Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13641973, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569590Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569721Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 33732689, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569842Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:12:35.975168Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:16.570092Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:14:17.740 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:16.608916+0000 mon.c (mon.1) 97 : audit [DBG] from='client.? 172.21.15.62:0/2728268786' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:14:17.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:16.869169+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:17.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:16.869593+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:17.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:16.869944+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:17.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:16.870265+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:17.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:16.870618+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:17.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:16.870945+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:17.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:16.871263+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:17.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:16.871566+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:17.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:16.871871+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:14:17.741 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:16.873425+0000 mon.c (mon.1) 107 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:14:17.742 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:16.873675+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:14:17.742 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:16.877592+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-22T19:14:17.742 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:16.883835+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:17.742 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:16.884714+0000 mon.c (mon.1) 109 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:14:17.742 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:17 smithi062 bash[64101]: audit 2024-02-22T19:14:16.884955+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:14:18.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:18 smithi063 bash[35391]: cluster 2024-02-22T19:14:16.706886+0000 mgr.y (mgr.24811) 8 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:18.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:18 smithi063 bash[35391]: audit 2024-02-22T19:14:16.932313+0000 mgr.y (mgr.24811) 9 : audit [DBG] from='client.14946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:14:18.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:18 smithi063 bash[35391]: audit 2024-02-22T19:14:18.304061+0000 mon.c (mon.1) 110 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:14:18.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:18 smithi063 bash[35391]: audit 2024-02-22T19:14:18.304438+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:14:18.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:18 smithi063 bash[35391]: audit 2024-02-22T19:14:18.305531+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T19:14:18.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:18 smithi063 bash[35391]: audit 2024-02-22T19:14:18.306490+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:14:18.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:18 smithi063 bash[35391]: audit 2024-02-22T19:14:18.307745+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-22T19:14:18.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:18 smithi062 bash[64101]: cluster 2024-02-22T19:14:16.706886+0000 mgr.y (mgr.24811) 8 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:18.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:18 smithi062 bash[64101]: audit 2024-02-22T19:14:16.932313+0000 mgr.y (mgr.24811) 9 : audit [DBG] from='client.14946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:14:18.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:18 smithi062 bash[64101]: audit 2024-02-22T19:14:18.304061+0000 mon.c (mon.1) 110 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:14:18.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:18 smithi062 bash[64101]: audit 2024-02-22T19:14:18.304438+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:14:18.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:18 smithi062 bash[64101]: audit 2024-02-22T19:14:18.305531+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T19:14:18.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:18 smithi062 bash[64101]: audit 2024-02-22T19:14:18.306490+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:14:18.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:18 smithi062 bash[64101]: audit 2024-02-22T19:14:18.307745+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-22T19:14:18.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:18 smithi062 bash[67442]: cluster 2024-02-22T19:14:16.706886+0000 mgr.y (mgr.24811) 8 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:18.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:18 smithi062 bash[67442]: audit 2024-02-22T19:14:16.932313+0000 mgr.y (mgr.24811) 9 : audit [DBG] from='client.14946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:14:18.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:18 smithi062 bash[67442]: audit 2024-02-22T19:14:18.304061+0000 mon.c (mon.1) 110 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:14:18.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:18 smithi062 bash[67442]: audit 2024-02-22T19:14:18.304438+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:14:18.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:18 smithi062 bash[67442]: audit 2024-02-22T19:14:18.305531+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T19:14:18.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:18 smithi062 bash[67442]: audit 2024-02-22T19:14:18.306490+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:14:18.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:18 smithi062 bash[67442]: audit 2024-02-22T19:14:18.307745+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-22T19:14:19.625 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:19 smithi063 bash[35391]: cephadm 2024-02-22T19:14:18.303548+0000 mgr.y (mgr.24811) 10 : cephadm [INF] Upgrade: Updating mgr.x 2024-02-22T19:14:19.625 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:19 smithi063 bash[35391]: cephadm 2024-02-22T19:14:18.307280+0000 mgr.y (mgr.24811) 11 : cephadm [INF] Deploying daemon mgr.x on smithi063 2024-02-22T19:14:19.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:19 smithi062 bash[64101]: cephadm 2024-02-22T19:14:18.303548+0000 mgr.y (mgr.24811) 10 : cephadm [INF] Upgrade: Updating mgr.x 2024-02-22T19:14:19.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:19 smithi062 bash[64101]: cephadm 2024-02-22T19:14:18.307280+0000 mgr.y (mgr.24811) 11 : cephadm [INF] Deploying daemon mgr.x on smithi063 2024-02-22T19:14:19.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:19 smithi062 bash[67442]: cephadm 2024-02-22T19:14:18.303548+0000 mgr.y (mgr.24811) 10 : cephadm [INF] Upgrade: Updating mgr.x 2024-02-22T19:14:19.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:19 smithi062 bash[67442]: cephadm 2024-02-22T19:14:18.307280+0000 mgr.y (mgr.24811) 11 : cephadm [INF] Deploying daemon mgr.x on smithi063 2024-02-22T19:14:19.963 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:19 smithi063 systemd[1]: Stopping Ceph mgr.x for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:14:20.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:20 smithi063 bash[35391]: cluster 2024-02-22T19:14:18.707304+0000 mgr.y (mgr.24811) 12 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:20.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:20 smithi062 bash[64101]: cluster 2024-02-22T19:14:18.707304+0000 mgr.y (mgr.24811) 12 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:20.734 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:20 smithi062 bash[67442]: cluster 2024-02-22T19:14:18.707304+0000 mgr.y (mgr.24811) 12 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:21.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:21 smithi063 bash[35391]: cluster 2024-02-22T19:14:20.707749+0000 mgr.y (mgr.24811) 13 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:21.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:21 smithi062 bash[64101]: cluster 2024-02-22T19:14:20.707749+0000 mgr.y (mgr.24811) 13 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:21.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:21 smithi062 bash[67442]: cluster 2024-02-22T19:14:20.707749+0000 mgr.y (mgr.24811) 13 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:24.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:23 smithi063 bash[35391]: cluster 2024-02-22T19:14:22.708465+0000 mgr.y (mgr.24811) 14 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:24.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:23 smithi062 bash[64101]: cluster 2024-02-22T19:14:22.708465+0000 mgr.y (mgr.24811) 14 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:24.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:23 smithi062 bash[67442]: cluster 2024-02-22T19:14:22.708465+0000 mgr.y (mgr.24811) 14 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:26.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:25 smithi063 bash[35391]: cluster 2024-02-22T19:14:24.709019+0000 mgr.y (mgr.24811) 15 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:26.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:25 smithi062 bash[64101]: cluster 2024-02-22T19:14:24.709019+0000 mgr.y (mgr.24811) 15 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:26.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:25 smithi062 bash[67442]: cluster 2024-02-22T19:14:24.709019+0000 mgr.y (mgr.24811) 15 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:28.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:27 smithi063 bash[35391]: cluster 2024-02-22T19:14:26.709803+0000 mgr.y (mgr.24811) 16 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:28.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:27 smithi062 bash[64101]: cluster 2024-02-22T19:14:26.709803+0000 mgr.y (mgr.24811) 16 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:28.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:27 smithi062 bash[67442]: cluster 2024-02-22T19:14:26.709803+0000 mgr.y (mgr.24811) 16 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:30.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:29 smithi063 bash[35391]: cluster 2024-02-22T19:14:28.710203+0000 mgr.y (mgr.24811) 17 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:30.214 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:29 smithi063 bash[51961]: time="2024-02-22T19:14:29Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr.x in 10 seconds, resorting to SIGKILL" 2024-02-22T19:14:30.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:29 smithi062 bash[64101]: cluster 2024-02-22T19:14:28.710203+0000 mgr.y (mgr.24811) 17 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:30.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:29 smithi062 bash[67442]: cluster 2024-02-22T19:14:28.710203+0000 mgr.y (mgr.24811) 17 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:30.713 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:30 smithi063 bash[51961]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr.x 2024-02-22T19:14:31.128 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:30 smithi063 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mgr.x.service: Main process exited, code=exited, status=137/n/a 2024-02-22T19:14:31.463 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:31 smithi063 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mgr.x.service: Failed with result 'exit-code'. 2024-02-22T19:14:31.464 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:31 smithi063 systemd[1]: Stopped Ceph mgr.x for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:14:31.464 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:31 smithi063 systemd[1]: Starting Ceph mgr.x for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:14:31.845 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:31 smithi063 bash[35391]: cluster 2024-02-22T19:14:30.710757+0000 mgr.y (mgr.24811) 18 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:31.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:31 smithi062 bash[64101]: cluster 2024-02-22T19:14:30.710757+0000 mgr.y (mgr.24811) 18 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:31.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:31 smithi062 bash[67442]: cluster 2024-02-22T19:14:30.710757+0000 mgr.y (mgr.24811) 18 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:32.213 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:31 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:31.843+0000 7f877a906700 1 -- 172.21.15.63:0/4243116525 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55bd3fa5e4e0 con 0x55bd3fa33000 2024-02-22T19:14:32.213 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:31 smithi063 bash[52150]: 6d5a1e303e09152dbd8e729b5dd34b12c58360e1a92e0f0bcd731a86ebed1e4a 2024-02-22T19:14:32.213 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:31 smithi063 systemd[1]: Started Ceph mgr.x for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:14:32.213 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:31 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:31.977+0000 7f878af01680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-22T19:14:32.214 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:32 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:32.064+0000 7f878af01680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-22T19:14:32.886 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:32 smithi062 bash[64101]: audit 2024-02-22T19:14:31.956839+0000 mon.c (mon.1) 114 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100600381, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568512Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568852Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44113592, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569003Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43809505, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569154Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46284144, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569301Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35043409, \"cpu_percentage\": \"0.90%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:16.569454Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13641973, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569590Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:16.569721Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 33732689, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569842Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:18.307147Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:32.887 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:32 smithi062 bash[67442]: audit 2024-02-22T19:14:31.956839+0000 mon.c (mon.1) 114 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100600381, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568512Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568852Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44113592, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569003Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43809505, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569154Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46284144, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569301Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35043409, \"cpu_percentage\": \"0.90%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:16.569454Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13641973, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569590Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:16.569721Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 33732689, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569842Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:18.307147Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:32.887 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:32 smithi062 bash[64101]: audit 2024-02-22T19:14:31.957441+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100600381, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568512Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568852Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44113592, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569003Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43809505, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569154Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46284144, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569301Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35043409, \"cpu_percentage\": \"0.90%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:16.569454Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13641973, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569590Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:16.569721Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 33732689, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569842Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:18.307147Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:32.888 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:32 smithi062 bash[67442]: audit 2024-02-22T19:14:31.957441+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100600381, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568512Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568852Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44113592, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569003Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43809505, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569154Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46284144, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569301Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35043409, \"cpu_percentage\": \"0.90%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:16.569454Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13641973, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569590Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:16.569721Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 33732689, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569842Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:18.307147Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:32.888 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:32 smithi062 bash[64101]: audit 2024-02-22T19:14:31.961096+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100600381, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568512Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568852Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44113592, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569003Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43809505, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569154Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46284144, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569301Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35043409, \"cpu_percentage\": \"0.90%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:16.569454Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13641973, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569590Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:16.569721Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 33732689, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569842Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:18.307147Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:14:32.888 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:32 smithi062 bash[64101]: audit 2024-02-22T19:14:31.962563+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:32.888 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:32 smithi062 bash[64101]: audit 2024-02-22T19:14:31.964469+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:14:32.888 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:32 smithi062 bash[67442]: audit 2024-02-22T19:14:31.961096+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100600381, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568512Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568852Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44113592, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569003Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43809505, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569154Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46284144, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569301Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35043409, \"cpu_percentage\": \"0.90%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:16.569454Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13641973, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569590Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:16.569721Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 33732689, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569842Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:18.307147Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:14:32.888 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:32 smithi062 bash[67442]: audit 2024-02-22T19:14:31.962563+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:32.889 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:32 smithi062 bash[67442]: audit 2024-02-22T19:14:31.964469+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:14:32.919 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:32 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:32.495+0000 7f878af01680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-22T19:14:32.920 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:32 smithi063 bash[35391]: audit 2024-02-22T19:14:31.956839+0000 mon.c (mon.1) 114 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100600381, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568512Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568852Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44113592, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569003Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43809505, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569154Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46284144, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569301Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35043409, \"cpu_percentage\": \"0.90%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:16.569454Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13641973, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569590Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:16.569721Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 33732689, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569842Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:18.307147Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:32.920 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:32 smithi063 bash[35391]: audit 2024-02-22T19:14:31.957441+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100600381, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568512Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568852Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44113592, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569003Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43809505, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569154Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46284144, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569301Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35043409, \"cpu_percentage\": \"0.90%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:16.569454Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13641973, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569590Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:16.569721Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 33732689, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569842Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:18.307147Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:32.920 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:32 smithi063 bash[35391]: audit 2024-02-22T19:14:31.961096+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 100600381, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568512Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45917143, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.568852Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44113592, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569003Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43809505, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569154Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46284144, \"cpu_percentage\": \"0.60%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569301Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\", \"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\"], \"memory_usage\": 35043409, \"cpu_percentage\": \"0.90%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:16.569454Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13641973, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569590Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31551651, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:16.569721Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 33732689, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:16.569842Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:18.307147Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:14:32.920 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:32 smithi063 bash[35391]: audit 2024-02-22T19:14:31.962563+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:32.920 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:32 smithi063 bash[35391]: audit 2024-02-22T19:14:31.964469+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:14:33.584 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:33 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:33.314+0000 7f878af01680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-22T19:14:33.584 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:33 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:33.395+0000 7f878af01680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-22T19:14:33.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:33 smithi063 bash[35391]: cluster 2024-02-22T19:14:32.711528+0000 mgr.y (mgr.24811) 19 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:33.964 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:33 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:33.615+0000 7f878af01680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-22T19:14:33.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:33 smithi062 bash[64101]: cluster 2024-02-22T19:14:32.711528+0000 mgr.y (mgr.24811) 19 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:33.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:33 smithi062 bash[67442]: cluster 2024-02-22T19:14:32.711528+0000 mgr.y (mgr.24811) 19 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:34.963 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:34 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:34.675+0000 7f878af01680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-22T19:14:34.963 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:34 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:34.824+0000 7f878af01680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-22T19:14:34.963 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:34 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:34.918+0000 7f878af01680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-22T19:14:35.425 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:35 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:35.022+0000 7f878af01680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-22T19:14:35.426 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:35 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:35.233+0000 7f878af01680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-22T19:14:35.713 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:35 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:35.530+0000 7f878af01680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-22T19:14:35.713 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:35 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:35.637+0000 7f878af01680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-22T19:14:36.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:35 smithi063 bash[35391]: cluster 2024-02-22T19:14:34.712070+0000 mgr.y (mgr.24811) 20 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:36.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:35 smithi062 bash[64101]: cluster 2024-02-22T19:14:34.712070+0000 mgr.y (mgr.24811) 20 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:36.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:35 smithi062 bash[67442]: cluster 2024-02-22T19:14:34.712070+0000 mgr.y (mgr.24811) 20 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:36.654 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:36 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:36.447+0000 7f878af01680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-22T19:14:36.654 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:36 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:36.541+0000 7f878af01680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-22T19:14:36.963 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:36 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:36.653+0000 7f878af01680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-22T19:14:36.963 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:36 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:36.836+0000 7f878af01680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-22T19:14:37.403 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:37 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:37.111+0000 7f878af01680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-22T19:14:37.404 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:37 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:37.248+0000 7f878af01680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-22T19:14:37.686 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:37 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:37.402+0000 7f878af01680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-22T19:14:37.686 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:37 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:37.597+0000 7f878af01680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-22T19:14:37.963 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:37 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:37.685+0000 7f878af01680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-22T19:14:37.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: cluster 2024-02-22T19:14:36.712726+0000 mgr.y (mgr.24811) 21 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:37.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.544008+0000 mon.c (mon.1) 117 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101953044, \"cpu_percentage\": \"1.03%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541587Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"6d5a1e303e09\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 43012587, \"cpu_percentage\": \"108.35%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:37.541790Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:14:31.411984Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46252687, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541886Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44375736, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541973Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44008734, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542057Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46535802, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542138Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\", \"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\"], \"memory_usage\": 35137781, \"cpu_percentage\": \"0.70%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542222Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542306Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31740395, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542407Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 34099691, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542492Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:18.307147Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:37.542652Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:37.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.544629+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101953044, \"cpu_percentage\": \"1.03%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541587Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"6d5a1e303e09\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 43012587, \"cpu_percentage\": \"108.35%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:37.541790Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:14:31.411984Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46252687, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541886Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44375736, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541973Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44008734, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542057Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46535802, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542138Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\", \"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\"], \"memory_usage\": 35137781, \"cpu_percentage\": \"0.70%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542222Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542306Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31740395, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542407Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 34099691, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542492Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:18.307147Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:37.542652Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:37.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.548244+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101953044, \"cpu_percentage\": \"1.03%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541587Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"6d5a1e303e09\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 43012587, \"cpu_percentage\": \"108.35%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:37.541790Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:14:31.411984Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46252687, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541886Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44375736, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541973Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44008734, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542057Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46535802, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542138Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\", \"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\"], \"memory_usage\": 35137781, \"cpu_percentage\": \"0.70%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542222Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542306Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31740395, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542407Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 34099691, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542492Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:18.307147Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:37.542652Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:14:37.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.552571+0000 mon.c (mon.1) 118 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:14:37.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.552913+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:14:37.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.555757+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-22T19:14:37.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.564409+0000 mon.c (mon.1) 119 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:37.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.565508+0000 mon.c (mon.1) 120 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:14:37.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.565837+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:14:37.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.567409+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:14:37.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.568399+0000 mon.c (mon.1) 122 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr"}]: dispatch 2024-02-22T19:14:37.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.568722+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr"}]: dispatch 2024-02-22T19:14:37.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.572607+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr"}]': finished 2024-02-22T19:14:37.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.575943+0000 mon.c (mon.1) 123 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-02-22T19:14:37.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.576252+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-02-22T19:14:37.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.579766+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-02-22T19:14:37.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.583323+0000 mon.c (mon.1) 124 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-02-22T19:14:37.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.583604+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-02-22T19:14:37.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.587024+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-02-22T19:14:37.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.590732+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-22T19:14:37.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.591524+0000 mon.c (mon.1) 126 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-02-22T19:14:37.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: cluster 2024-02-22T19:14:37.700815+0000 mon.a (mon.0) 710 : cluster [DBG] Standby manager daemon x restarted 2024-02-22T19:14:37.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: cluster 2024-02-22T19:14:37.700942+0000 mon.a (mon.0) 711 : cluster [DBG] Standby manager daemon x started 2024-02-22T19:14:37.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.701690+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.? 172.21.15.63:0/4163653361' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T19:14:37.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.702165+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.? 172.21.15.63:0/4163653361' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:14:37.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.703199+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.? 172.21.15.63:0/4163653361' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T19:14:37.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:37 smithi063 bash[35391]: audit 2024-02-22T19:14:37.703439+0000 mon.b (mon.2) 167 : audit [DBG] from='mgr.? 172.21.15.63:0/4163653361' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:14:38.036 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: cluster 2024-02-22T19:14:36.712726+0000 mgr.y (mgr.24811) 21 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:38.039 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: cluster 2024-02-22T19:14:36.712726+0000 mgr.y (mgr.24811) 21 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:38.040 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.544008+0000 mon.c (mon.1) 117 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101953044, \"cpu_percentage\": \"1.03%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541587Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"6d5a1e303e09\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 43012587, \"cpu_percentage\": \"108.35%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:37.541790Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:14:31.411984Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46252687, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541886Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44375736, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541973Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44008734, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542057Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46535802, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542138Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\", \"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\"], \"memory_usage\": 35137781, \"cpu_percentage\": \"0.70%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542222Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542306Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31740395, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542407Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 34099691, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542492Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:18.307147Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:37.542652Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:38.040 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.544629+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101953044, \"cpu_percentage\": \"1.03%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541587Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"6d5a1e303e09\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 43012587, \"cpu_percentage\": \"108.35%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:37.541790Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:14:31.411984Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46252687, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541886Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44375736, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541973Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44008734, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542057Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46535802, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542138Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\", \"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\"], \"memory_usage\": 35137781, \"cpu_percentage\": \"0.70%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542222Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542306Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31740395, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542407Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 34099691, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542492Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:18.307147Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:37.542652Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:38.040 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.548244+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101953044, \"cpu_percentage\": \"1.03%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541587Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"6d5a1e303e09\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 43012587, \"cpu_percentage\": \"108.35%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:37.541790Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:14:31.411984Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46252687, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541886Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44375736, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541973Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44008734, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542057Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46535802, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542138Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\", \"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\"], \"memory_usage\": 35137781, \"cpu_percentage\": \"0.70%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542222Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542306Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31740395, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542407Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 34099691, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542492Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:18.307147Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:37.542652Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:14:38.040 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.552571+0000 mon.c (mon.1) 118 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:14:38.040 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.552913+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:14:38.040 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.555757+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-22T19:14:38.040 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.564409+0000 mon.c (mon.1) 119 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:38.041 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.565508+0000 mon.c (mon.1) 120 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:14:38.041 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.565837+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:14:38.041 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.567409+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:14:38.041 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.568399+0000 mon.c (mon.1) 122 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr"}]: dispatch 2024-02-22T19:14:38.041 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.568722+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr"}]: dispatch 2024-02-22T19:14:38.041 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.544008+0000 mon.c (mon.1) 117 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101953044, \"cpu_percentage\": \"1.03%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541587Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"6d5a1e303e09\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 43012587, \"cpu_percentage\": \"108.35%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:37.541790Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:14:31.411984Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46252687, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541886Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44375736, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541973Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44008734, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542057Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46535802, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542138Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\", \"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\"], \"memory_usage\": 35137781, \"cpu_percentage\": \"0.70%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542222Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542306Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31740395, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542407Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 34099691, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542492Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:18.307147Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:37.542652Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:38.041 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.544629+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101953044, \"cpu_percentage\": \"1.03%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541587Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"6d5a1e303e09\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 43012587, \"cpu_percentage\": \"108.35%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:37.541790Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:14:31.411984Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46252687, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541886Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44375736, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541973Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44008734, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542057Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46535802, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542138Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\", \"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\"], \"memory_usage\": 35137781, \"cpu_percentage\": \"0.70%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542222Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542306Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31740395, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542407Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 34099691, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542492Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:18.307147Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:37.542652Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:38.042 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.572607+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr"}]': finished 2024-02-22T19:14:38.042 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.575943+0000 mon.c (mon.1) 123 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-02-22T19:14:38.042 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.576252+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-02-22T19:14:38.042 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.579766+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-02-22T19:14:38.042 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.583323+0000 mon.c (mon.1) 124 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-02-22T19:14:38.042 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.583604+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-02-22T19:14:38.042 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.587024+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-02-22T19:14:38.042 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.590732+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-22T19:14:38.042 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.591524+0000 mon.c (mon.1) 126 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-02-22T19:14:38.042 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: cluster 2024-02-22T19:14:37.700815+0000 mon.a (mon.0) 710 : cluster [DBG] Standby manager daemon x restarted 2024-02-22T19:14:38.042 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: cluster 2024-02-22T19:14:37.700942+0000 mon.a (mon.0) 711 : cluster [DBG] Standby manager daemon x started 2024-02-22T19:14:38.042 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.701690+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.? 172.21.15.63:0/4163653361' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T19:14:38.042 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.702165+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.? 172.21.15.63:0/4163653361' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:14:38.043 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.703199+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.? 172.21.15.63:0/4163653361' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T19:14:38.043 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[64101]: audit 2024-02-22T19:14:37.703439+0000 mon.b (mon.2) 167 : audit [DBG] from='mgr.? 172.21.15.63:0/4163653361' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:14:38.043 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.548244+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi063","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi063\", \"container_id\": \"deb740d884ca\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101953044, \"cpu_percentage\": \"1.03%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541587Z\", \"created\": \"2024-02-22T19:04:34.723894Z\", \"started\": \"2024-02-22T19:04:34.759372Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi063\", \"container_id\": \"6d5a1e303e09\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 43012587, \"cpu_percentage\": \"108.35%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:37.541790Z\", \"created\": \"2024-02-22T19:04:48.649751Z\", \"started\": \"2024-02-22T19:14:31.411984Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi063\", \"container_id\": \"0affbe803c22\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46252687, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541886Z\", \"created\": \"2024-02-22T19:06:21.296797Z\", \"started\": \"2024-02-22T19:06:24.227880Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi063\", \"container_id\": \"636665ed6108\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44375736, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.541973Z\", \"created\": \"2024-02-22T19:06:42.104590Z\", \"started\": \"2024-02-22T19:06:44.713378Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi063\", \"container_id\": \"8c48e05bc7dd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44008734, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542057Z\", \"created\": \"2024-02-22T19:07:01.273403Z\", \"started\": \"2024-02-22T19:07:03.001932Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi063\", \"container_id\": \"c298ad18c8bb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46535802, \"cpu_percentage\": \"0.59%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542138Z\", \"created\": \"2024-02-22T19:07:20.668214Z\", \"started\": \"2024-02-22T19:07:22.324269Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi063\", \"container_id\": \"564ec2e44075\", \"container_image_id\": \"38c53d8da7841cb526aa0959f00a183885b3c8e45397d8c1a00373fc072cb19a\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:042258e3578a558ce41b036104dfa997b2d25151ab6889a3f4d6187e27b1176c\", \"docker.io/prom/prometheus@sha256:240041486d99744622ef1cb363d0da5b1b52f9f6863d98d7df4bdb530a978df1\"], \"memory_usage\": 35137781, \"cpu_percentage\": \"0.70%\", \"version\": \"2.50.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542222Z\", \"created\": \"2024-02-22T19:07:49.999926Z\", \"started\": \"2024-02-22T19:13:41.055193Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi063\", \"container_id\": \"ab2867e3fd57\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13704888, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542306Z\", \"created\": \"2024-02-22T19:07:52.669900Z\", \"started\": \"2024-02-22T19:08:01.294641Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi063\", \"container_id\": \"9863e2980fa6\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 31740395, \"cpu_percentage\": \"0.48%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542407Z\", \"created\": \"2024-02-22T19:08:29.248540Z\", \"started\": \"2024-02-22T19:08:29.358742Z\"}, \"rgw.r.z.smithi063.feyald\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi063.feyald\", \"daemon_name\": \"rgw.r.z.smithi063.feyald\", \"hostname\": \"smithi063\", \"container_id\": \"478364f15ee3\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 34099691, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:37.542492Z\", \"created\": \"2024-02-22T19:09:25.934973Z\", \"started\": \"2024-02-22T19:09:25.968393Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666969Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"70486b6f-31d1-487f-872d-f3ea7cc3d4cc\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"qvJaQI-gWSd-UAkW-QeSE-crfH-oZCm-Voaoe7\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0228dda5-c78b-479f-a7a0-4fe88baed26d\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"2otT2S-lfyk-UXPw-GYQc-2oDN-cZht-IqZro4\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f67bd7fb-661e-4746-a736-7faf48782399\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"pdAK7r-u9PH-Exl9-TyGB-SNkN-y5qI-vWxLMJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7fb59916-d40a-4445-a5f8-6d38a8750b27\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"fyJ58H-BmuO-FKwZ-3wI6-edzC-7fk7-3ePM5y\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT5344005B400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.666978Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W2X1\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:29.359241Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:18.307147Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:19.651141Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:40.519877Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:59.363678Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:19.059730Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-22T19:13:31.100033Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.161463Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-22T19:08:09.344254Z\"}, \"rgw.r.z.smithi063.feyald\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:24.216170Z\"}}, \"last_daemon_update\": \"2024-02-22T19:14:37.542652Z\", \"last_device_update\": \"2024-02-22T19:07:26.785279Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:14:11.316243Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-22T19:14:38.043 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.552571+0000 mon.c (mon.1) 118 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:14:38.043 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.552913+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-22T19:14:38.043 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.555757+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-22T19:14:38.043 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.564409+0000 mon.c (mon.1) 119 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:38.043 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.565508+0000 mon.c (mon.1) 120 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:14:38.043 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.565837+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-22T19:14:38.043 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.567409+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:14:38.043 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.568399+0000 mon.c (mon.1) 122 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr"}]: dispatch 2024-02-22T19:14:38.044 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.568722+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr"}]: dispatch 2024-02-22T19:14:38.044 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.572607+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mgr"}]': finished 2024-02-22T19:14:38.044 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.575943+0000 mon.c (mon.1) 123 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-02-22T19:14:38.044 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.576252+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-02-22T19:14:38.044 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.579766+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-02-22T19:14:38.044 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.583323+0000 mon.c (mon.1) 124 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-02-22T19:14:38.044 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.583604+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-02-22T19:14:38.044 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.587024+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-02-22T19:14:38.044 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.590732+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-22T19:14:38.044 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.591524+0000 mon.c (mon.1) 126 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-02-22T19:14:38.044 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: cluster 2024-02-22T19:14:37.700815+0000 mon.a (mon.0) 710 : cluster [DBG] Standby manager daemon x restarted 2024-02-22T19:14:38.044 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: cluster 2024-02-22T19:14:37.700942+0000 mon.a (mon.0) 711 : cluster [DBG] Standby manager daemon x started 2024-02-22T19:14:38.044 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.701690+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.? 172.21.15.63:0/4163653361' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T19:14:38.044 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.702165+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.? 172.21.15.63:0/4163653361' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:14:38.044 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.703199+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.? 172.21.15.63:0/4163653361' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T19:14:38.045 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:37 smithi062 bash[67442]: audit 2024-02-22T19:14:37.703439+0000 mon.b (mon.2) 167 : audit [DBG] from='mgr.? 172.21.15.63:0/4163653361' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:14:38.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:38 smithi062 bash[64101]: cephadm 2024-02-22T19:14:37.568160+0000 mgr.y (mgr.24811) 22 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-22T19:14:38.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:38 smithi062 bash[64101]: cephadm 2024-02-22T19:14:37.592115+0000 mgr.y (mgr.24811) 23 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2024-02-22T19:14:38.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:38 smithi062 bash[64101]: cluster 2024-02-22T19:14:38.591672+0000 mon.a (mon.0) 712 : cluster [DBG] mgrmap e24: y(active, since 34s), standbys: x 2024-02-22T19:14:38.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:38 smithi062 bash[67442]: cephadm 2024-02-22T19:14:37.568160+0000 mgr.y (mgr.24811) 22 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-22T19:14:38.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:38 smithi062 bash[67442]: cephadm 2024-02-22T19:14:37.592115+0000 mgr.y (mgr.24811) 23 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2024-02-22T19:14:38.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:38 smithi062 bash[67442]: cluster 2024-02-22T19:14:38.591672+0000 mon.a (mon.0) 712 : cluster [DBG] mgrmap e24: y(active, since 34s), standbys: x 2024-02-22T19:14:39.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:38 smithi063 bash[35391]: cephadm 2024-02-22T19:14:37.568160+0000 mgr.y (mgr.24811) 22 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-22T19:14:39.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:38 smithi063 bash[35391]: cephadm 2024-02-22T19:14:37.592115+0000 mgr.y (mgr.24811) 23 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2024-02-22T19:14:39.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:38 smithi063 bash[35391]: cluster 2024-02-22T19:14:38.591672+0000 mon.a (mon.0) 712 : cluster [DBG] mgrmap e24: y(active, since 34s), standbys: x 2024-02-22T19:14:39.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:39 smithi062 bash[64101]: cluster 2024-02-22T19:14:38.713049+0000 mgr.y (mgr.24811) 24 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:39.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:39 smithi062 bash[64101]: cephadm 2024-02-22T19:14:39.111233+0000 mgr.y (mgr.24811) 25 : cephadm [INF] Upgrade: Updating mon.a 2024-02-22T19:14:39.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:39 smithi062 bash[64101]: audit 2024-02-22T19:14:39.111676+0000 mon.c (mon.1) 127 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mon.a"}]: dispatch 2024-02-22T19:14:39.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:39 smithi062 bash[64101]: audit 2024-02-22T19:14:39.112026+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mon.a"}]: dispatch 2024-02-22T19:14:39.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:39 smithi062 bash[64101]: audit 2024-02-22T19:14:39.116483+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mon.a"}]': finished 2024-02-22T19:14:39.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:39 smithi062 bash[64101]: audit 2024-02-22T19:14:39.117395+0000 mon.c (mon.1) 128 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:14:39.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:39 smithi062 bash[64101]: audit 2024-02-22T19:14:39.118101+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:14:39.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:39 smithi062 bash[64101]: audit 2024-02-22T19:14:39.118779+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:14:39.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:39 smithi062 bash[64101]: cephadm 2024-02-22T19:14:39.119397+0000 mgr.y (mgr.24811) 26 : cephadm [INF] Deploying daemon mon.a on smithi062 2024-02-22T19:14:39.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:39 smithi062 bash[64101]: audit 2024-02-22T19:14:39.119779+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-22T19:14:39.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:39 smithi062 bash[67442]: cluster 2024-02-22T19:14:38.713049+0000 mgr.y (mgr.24811) 24 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:39.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:39 smithi062 bash[67442]: cephadm 2024-02-22T19:14:39.111233+0000 mgr.y (mgr.24811) 25 : cephadm [INF] Upgrade: Updating mon.a 2024-02-22T19:14:39.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:39 smithi062 bash[67442]: audit 2024-02-22T19:14:39.111676+0000 mon.c (mon.1) 127 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mon.a"}]: dispatch 2024-02-22T19:14:39.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:39 smithi062 bash[67442]: audit 2024-02-22T19:14:39.112026+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mon.a"}]: dispatch 2024-02-22T19:14:39.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:39 smithi062 bash[67442]: audit 2024-02-22T19:14:39.116483+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mon.a"}]': finished 2024-02-22T19:14:39.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:39 smithi062 bash[67442]: audit 2024-02-22T19:14:39.117395+0000 mon.c (mon.1) 128 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:14:39.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:39 smithi062 bash[67442]: audit 2024-02-22T19:14:39.118101+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:14:39.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:39 smithi062 bash[67442]: audit 2024-02-22T19:14:39.118779+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:14:39.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:39 smithi062 bash[67442]: cephadm 2024-02-22T19:14:39.119397+0000 mgr.y (mgr.24811) 26 : cephadm [INF] Deploying daemon mon.a on smithi062 2024-02-22T19:14:39.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:39 smithi062 bash[67442]: audit 2024-02-22T19:14:39.119779+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-22T19:14:40.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:39 smithi063 bash[35391]: cluster 2024-02-22T19:14:38.713049+0000 mgr.y (mgr.24811) 24 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:40.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:39 smithi063 bash[35391]: cephadm 2024-02-22T19:14:39.111233+0000 mgr.y (mgr.24811) 25 : cephadm [INF] Upgrade: Updating mon.a 2024-02-22T19:14:40.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:39 smithi063 bash[35391]: audit 2024-02-22T19:14:39.111676+0000 mon.c (mon.1) 127 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mon.a"}]: dispatch 2024-02-22T19:14:40.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:39 smithi063 bash[35391]: audit 2024-02-22T19:14:39.112026+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mon.a"}]: dispatch 2024-02-22T19:14:40.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:39 smithi063 bash[35391]: audit 2024-02-22T19:14:39.116483+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mon.a"}]': finished 2024-02-22T19:14:40.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:39 smithi063 bash[35391]: audit 2024-02-22T19:14:39.117395+0000 mon.c (mon.1) 128 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:14:40.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:39 smithi063 bash[35391]: audit 2024-02-22T19:14:39.118101+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:14:40.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:39 smithi063 bash[35391]: audit 2024-02-22T19:14:39.118779+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:14:40.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:39 smithi063 bash[35391]: cephadm 2024-02-22T19:14:39.119397+0000 mgr.y (mgr.24811) 26 : cephadm [INF] Deploying daemon mon.a on smithi062 2024-02-22T19:14:40.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:39 smithi063 bash[35391]: audit 2024-02-22T19:14:39.119779+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-22T19:14:40.722 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:40 smithi062 systemd[1]: Stopping Ceph mon.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:14:40.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:40 smithi062 bash[64101]: debug 2024-02-22T19:14:40.721+0000 7fce52b73700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:14:40.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:40 smithi062 bash[64101]: debug 2024-02-22T19:14:40.721+0000 7fce52b73700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-02-22T19:14:41.579 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:41 smithi062 bash[89100]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon.a 2024-02-22T19:14:42.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.a.service: Succeeded. 2024-02-22T19:14:42.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 systemd[1]: Stopped Ceph mon.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:14:42.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 systemd[1]: Starting Ceph mon.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:14:42.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.640+0000 7f31a87d4880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-22T19:14:42.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.640+0000 7f31a87d4880 0 ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable), process ceph-mon, pid 7 2024-02-22T19:14:42.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.640+0000 7f31a87d4880 0 pidfile_write: ignore empty --pid-file 2024-02-22T19:14:42.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.644+0000 7f31a87d4880 0 load: jerasure load: lrc load: isa 2024-02-22T19:14:42.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: RocksDB version: 6.8.1 2024-02-22T19:14:42.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:42.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-22T19:14:42.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Compile date Feb 20 2024 2024-02-22T19:14:42.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: DB SUMMARY 2024-02-22T19:14:42.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:42.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: CURRENT file: CURRENT 2024-02-22T19:14:42.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:42.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-22T19:14:42.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:42.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: MANIFEST file: MANIFEST-000008 size: 743 Bytes 2024-02-22T19:14:42.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:42.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 2, files: 000023.sst 000024.sst 2024-02-22T19:14:42.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:42.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000021.log size: 18687565 ; 2024-02-22T19:14:42.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:42.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.error_if_exists: 0 2024-02-22T19:14:42.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.create_if_missing: 0 2024-02-22T19:14:42.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.paranoid_checks: 1 2024-02-22T19:14:42.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.env: 0x55f0fd17f080 2024-02-22T19:14:42.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.fs: Posix File System 2024-02-22T19:14:42.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.info_log: 0x55f0fe2f8260 2024-02-22T19:14:42.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-22T19:14:42.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.statistics: (nil) 2024-02-22T19:14:42.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.use_fsync: 0 2024-02-22T19:14:42.987 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_log_file_size: 0 2024-02-22T19:14:42.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-22T19:14:42.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-22T19:14:42.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-22T19:14:42.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-22T19:14:42.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.allow_fallocate: 1 2024-02-22T19:14:42.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-22T19:14:42.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-22T19:14:42.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.use_direct_reads: 0 2024-02-22T19:14:42.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-22T19:14:42.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-22T19:14:42.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.db_log_dir: 2024-02-22T19:14:42.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-02-22T19:14:42.988 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-22T19:14:42.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_subcompactions: 1 2024-02-22T19:14:42.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_background_flushes: -1 2024-02-22T19:14:42.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-22T19:14:42.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-22T19:14:42.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-22T19:14:42.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-22T19:14:42.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-22T19:14:42.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-22T19:14:42.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-22T19:14:42.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.write_buffer_manager: 0x55f0fefea360 2024-02-22T19:14:42.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-22T19:14:42.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-22T19:14:42.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-22T19:14:42.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-22T19:14:42.989 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-22T19:14:42.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-22T19:14:42.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-22T19:14:42.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-22T19:14:42.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-22T19:14:42.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.unordered_write: 0 2024-02-22T19:14:42.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-22T19:14:42.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-22T19:14:42.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-22T19:14:42.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-22T19:14:42.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.row_cache: None 2024-02-22T19:14:42.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.wal_filter: None 2024-02-22T19:14:42.990 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-22T19:14:42.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-22T19:14:42.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.preserve_deletes: 0 2024-02-22T19:14:42.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.two_write_queues: 0 2024-02-22T19:14:42.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-22T19:14:42.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.atomic_flush: 0 2024-02-22T19:14:42.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-22T19:14:42.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-22T19:14:42.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-22T19:14:42.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.log_readahead_size: 0 2024-02-22T19:14:42.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-22T19:14:42.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_background_jobs: 2 2024-02-22T19:14:42.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_background_compactions: -1 2024-02-22T19:14:42.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-22T19:14:42.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-22T19:14:42.991 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-22T19:14:42.992 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-22T19:14:42.992 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-22T19:14:42.992 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-22T19:14:42.993 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-22T19:14:42.993 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-22T19:14:42.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_open_files: -1 2024-02-22T19:14:42.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-22T19:14:42.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-22T19:14:42.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-22T19:14:42.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-22T19:14:42.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Compression algorithms supported: 2024-02-22T19:14:42.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-22T19:14:42.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: kZSTD supported: 0 2024-02-22T19:14:42.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: kXpressCompression supported: 0 2024-02-22T19:14:42.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-22T19:14:42.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: kLZ4Compression supported: 1 2024-02-22T19:14:42.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: kBZip2Compression supported: 0 2024-02-22T19:14:42.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: kZlibCompression supported: 1 2024-02-22T19:14:42.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: kSnappyCompression supported: 1 2024-02-22T19:14:42.994 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-22T19:14:42.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 2024-02-22T19:14:42.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:42.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-22T19:14:42.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:42.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-22T19:14:42.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.merge_operator: 2024-02-22T19:14:42.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.compaction_filter: None 2024-02-22T19:14:42.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-22T19:14:42.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-22T19:14:42.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-22T19:14:42.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f0fe29dd10) 2024-02-22T19:14:42.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cache_index_and_filter_blocks: 1 2024-02-22T19:14:42.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-22T19:14:42.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-22T19:14:42.995 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: pin_top_level_index_and_filter: 1 2024-02-22T19:14:42.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: index_type: 0 2024-02-22T19:14:42.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: data_block_index_type: 0 2024-02-22T19:14:42.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: index_shortening: 1 2024-02-22T19:14:42.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: data_block_hash_table_util_ratio: 0.750000 2024-02-22T19:14:42.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: hash_index_allow_collision: 1 2024-02-22T19:14:42.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: checksum: 1 2024-02-22T19:14:42.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: no_block_cache: 0 2024-02-22T19:14:42.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: block_cache: 0x55f0fe2d2f10 2024-02-22T19:14:42.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: block_cache_name: BinnedLRUCache 2024-02-22T19:14:42.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: block_cache_options: 2024-02-22T19:14:42.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: capacity : 536870912 2024-02-22T19:14:42.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: num_shard_bits : 4 2024-02-22T19:14:42.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: strict_capacity_limit : 0 2024-02-22T19:14:42.996 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: high_pri_pool_ratio: 0.000 2024-02-22T19:14:42.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: block_cache_compressed: (nil) 2024-02-22T19:14:42.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: persistent_cache: (nil) 2024-02-22T19:14:42.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: block_size: 4096 2024-02-22T19:14:42.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: block_size_deviation: 10 2024-02-22T19:14:42.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: block_restart_interval: 16 2024-02-22T19:14:42.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: index_block_restart_interval: 1 2024-02-22T19:14:42.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: metadata_block_size: 4096 2024-02-22T19:14:42.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: partition_filters: 0 2024-02-22T19:14:42.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: use_delta_encoding: 1 2024-02-22T19:14:42.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-22T19:14:42.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: whole_key_filtering: 1 2024-02-22T19:14:42.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: verify_compression: 0 2024-02-22T19:14:42.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: read_amp_bytes_per_bit: 0 2024-02-22T19:14:42.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: format_version: 2 2024-02-22T19:14:42.997 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: enable_index_compression: 1 2024-02-22T19:14:42.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: block_align: 0 2024-02-22T19:14:42.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:42.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-22T19:14:42.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-22T19:14:42.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.compression: NoCompression 2024-02-22T19:14:42.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-22T19:14:42.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-22T19:14:42.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-22T19:14:42.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.num_levels: 7 2024-02-22T19:14:42.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-22T19:14:42.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-22T19:14:42.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-22T19:14:42.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-22T19:14:42.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-22T19:14:42.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-22T19:14:42.998 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-22T19:14:42.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-22T19:14:42.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-22T19:14:42.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-22T19:14:42.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-22T19:14:42.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-22T19:14:42.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-22T19:14:42.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-22T19:14:42.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-22T19:14:42.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-22T19:14:42.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-22T19:14:42.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-22T19:14:42.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-22T19:14:42.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-22T19:14:42.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-22T19:14:42.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-22T19:14:42.999 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-22T19:14:43.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-22T19:14:43.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-22T19:14:43.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-22T19:14:43.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-22T19:14:43.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-22T19:14:43.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-22T19:14:43.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-22T19:14:43.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-22T19:14:43.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-22T19:14:43.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-22T19:14:43.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-22T19:14:43.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-22T19:14:43.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-22T19:14:43.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-22T19:14:43.000 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-22T19:14:43.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-22T19:14:43.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-22T19:14:43.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-22T19:14:43.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-22T19:14:43.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-22T19:14:43.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-22T19:14:43.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-22T19:14:43.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-22T19:14:43.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-22T19:14:43.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.table_properties_collectors: 2024-02-22T19:14:43.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.inplace_update_support: 0 2024-02-22T19:14:43.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-22T19:14:43.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-22T19:14:43.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-22T19:14:43.001 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-22T19:14:43.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.bloom_locality: 0 2024-02-22T19:14:43.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.max_successive_merges: 0 2024-02-22T19:14:43.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-22T19:14:43.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-22T19:14:43.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-22T19:14:43.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-22T19:14:43.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.ttl: 2592000 2024-02-22T19:14:43.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.645+0000 7f31a87d4880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-22T19:14:43.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.646+0000 7f31a87d4880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 26, last_sequence is 8725, log_number is 21,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-22T19:14:43.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:43.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.646+0000 7f31a87d4880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 21 2024-02-22T19:14:43.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:43.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.646+0000 7f31a87d4880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708629282647425, "job": 1, "event": "recovery_started", "log_files": [21]} 2024-02-22T19:14:43.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.646+0000 7f31a87d4880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #21 mode 2 2024-02-22T19:14:43.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.664+0000 7f31a87d4880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-22T19:14:43.002 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.690+0000 7f31a87d4880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708629282690705, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 26, "file_size": 18515045, "table_properties": {"data_size": 18504825, "index_size": 8308, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 1093, "raw_key_size": 8504, "raw_average_key_size": 21, "raw_value_size": 18492939, "raw_average_value_size": 47539, "num_data_blocks": 258, "num_entries": 389, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708629282, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-22T19:14:43.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.690+0000 7f31a87d4880 4 rocksdb: [version_set.cc:3826] Creating manifest 27 2024-02-22T19:14:43.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:43.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.690+0000 7f31a87d4880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708629282691158, "job": 1, "event": "recovery_finished"} 2024-02-22T19:14:43.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.692+0000 7f31a87d4880 4 rocksdb: DB pointer 0x55f0fe39b800 2024-02-22T19:14:43.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.692+0000 7f318f5c6700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-22T19:14:43.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.692+0000 7f318f5c6700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-22T19:14:43.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: ** DB Stats ** 2024-02-22T19:14:43.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T19:14:43.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-22T19:14:43.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-22T19:14:43.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T19:14:43.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-22T19:14:43.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-22T19:14:43.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T19:14:43.003 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:43.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: ** Compaction Stats [default] ** 2024-02-22T19:14:43.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T19:14:43.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T19:14:43.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: L0 1/0 17.66 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 697.2 0.03 0.00 1 0.025 0 0 2024-02-22T19:14:43.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: L6 2/0 66.54 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T19:14:43.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Sum 3/0 84.19 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 697.2 0.03 0.00 1 0.025 0 0 2024-02-22T19:14:43.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 697.2 0.03 0.00 1 0.025 0 0 2024-02-22T19:14:43.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:43.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: ** Compaction Stats [default] ** 2024-02-22T19:14:43.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T19:14:43.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T19:14:43.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 697.2 0.03 0.00 1 0.025 0 0 2024-02-22T19:14:43.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T19:14:43.004 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Flush(GB): cumulative 0.017, interval 0.017 2024-02-22T19:14:43.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T19:14:43.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T19:14:43.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T19:14:43.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: AddFile(Keys): cumulative 0, interval 0 2024-02-22T19:14:43.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Cumulative compaction: 0.02 GB write, 377.11 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T19:14:43.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Interval compaction: 0.02 GB write, 377.11 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T19:14:43.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T19:14:43.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:43.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: ** File Read Latency Histogram By Level [default] ** 2024-02-22T19:14:43.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:43.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: ** Compaction Stats [default] ** 2024-02-22T19:14:43.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T19:14:43.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T19:14:43.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: L0 1/0 17.66 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 697.2 0.03 0.00 1 0.025 0 0 2024-02-22T19:14:43.005 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: L6 2/0 66.54 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T19:14:43.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Sum 3/0 84.19 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 697.2 0.03 0.00 1 0.025 0 0 2024-02-22T19:14:43.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T19:14:43.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:43.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: ** Compaction Stats [default] ** 2024-02-22T19:14:43.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T19:14:43.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T19:14:43.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 697.2 0.03 0.00 1 0.025 0 0 2024-02-22T19:14:43.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T19:14:43.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Flush(GB): cumulative 0.017, interval 0.000 2024-02-22T19:14:43.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T19:14:43.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T19:14:43.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T19:14:43.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: AddFile(Keys): cumulative 0, interval 0 2024-02-22T19:14:43.006 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Cumulative compaction: 0.02 GB write, 376.84 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T19:14:43.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T19:14:43.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T19:14:43.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:43.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: ** File Read Latency Histogram By Level [default] ** 2024-02-22T19:14:43.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:43.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.693+0000 7f31a87d4880 0 starting mon.a rank 0 at public addrs [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] at bind addrs [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:14:43.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.693+0000 7f31a87d4880 1 mon.a@-1(???) e3 preinit fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:14:43.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.694+0000 7f31a87d4880 0 mon.a@-1(???).mds e1 new map 2024-02-22T19:14:43.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.694+0000 7f31a87d4880 0 mon.a@-1(???).mds e1 print_map 2024-02-22T19:14:43.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: e1 2024-02-22T19:14:43.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: enable_multiple, ever_enabled_multiple: 0,0 2024-02-22T19:14:43.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T19:14:43.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: legacy client fscid: -1 2024-02-22T19:14:43.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:43.007 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: No filesystems configured 2024-02-22T19:14:43.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: 2024-02-22T19:14:43.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.694+0000 7f31a87d4880 0 mon.a@-1(???).osd e62 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-22T19:14:43.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.694+0000 7f31a87d4880 0 mon.a@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T19:14:43.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.694+0000 7f31a87d4880 0 mon.a@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T19:14:43.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.694+0000 7f31a87d4880 0 mon.a@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T19:14:43.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:38.713049+0000 mgr.y (mgr.24811) 24 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:43.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:14:39.111233+0000 mgr.y (mgr.24811) 25 : cephadm [INF] Upgrade: Updating mon.a 2024-02-22T19:14:43.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:39.111676+0000 mon.c (mon.1) 127 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mon.a"}]: dispatch 2024-02-22T19:14:43.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:39.112026+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mon.a"}]: dispatch 2024-02-22T19:14:43.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:39.116483+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.24811 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010", "who": "mon.a"}]': finished 2024-02-22T19:14:43.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:39.117395+0000 mon.c (mon.1) 128 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:14:43.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:39.118101+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:14:43.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:39.118779+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:14:43.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:14:39.119397+0000 mgr.y (mgr.24811) 26 : cephadm [INF] Deploying daemon mon.a on smithi062 2024-02-22T19:14:43.008 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:39.119779+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-22T19:14:43.009 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:14:42.694+0000 7f31a87d4880 1 mon.a@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2024-02-22T19:14:43.009 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 bash[89286]: 6a53ef7a2bff6bacdad2fa8119c854b0d0de25c89cb851de63fce7cecb6a54a7 2024-02-22T19:14:43.009 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:42 smithi062 systemd[1]: Started Ceph mon.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:14:44.463 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:44 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: ignoring --setuser ceph since I am not root 2024-02-22T19:14:44.464 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:44 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: ignoring --setgroup ceph since I am not root 2024-02-22T19:14:44.464 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:44 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:44.173+0000 7f8fe46a8700 1 -- 172.21.15.63:0/22425853 <== mon.2 v2:172.21.15.63:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55926e7824e0 con 0x55926e759000 2024-02-22T19:14:44.464 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:44 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:44.303+0000 7f8ff4885680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-22T19:14:44.464 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:44 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:44.388+0000 7f8ff4885680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-22T19:14:44.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:44 smithi063 bash[35391]: cluster 2024-02-22T19:14:40.713575+0000 mgr.y (mgr.24811) 27 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:44.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:44 smithi063 bash[35391]: cluster 2024-02-22T19:14:42.714107+0000 mgr.y (mgr.24811) 28 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:44.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:44 smithi063 bash[35391]: audit 2024-02-22T19:14:42.755888+0000 mon.c (mon.1) 132 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 425197568, \"cpu_percentage\": \"54.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:15.424285Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102770933, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424431Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48769269, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424576Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48570040, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424719Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42289070, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424862Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44868567, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425002Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13914603, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425135Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:15.425277Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35190210, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425406Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:39.119299Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:44.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:44 smithi063 bash[35391]: cluster 2024-02-22T19:14:44.103562+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2024-02-22T19:14:44.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:44 smithi063 bash[35391]: cluster 2024-02-22T19:14:44.117371+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-22T19:14:44.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:44 smithi063 bash[35391]: cluster 2024-02-22T19:14:44.121341+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0],b=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],c=[v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0]} removed_ranks: {} 2024-02-22T19:14:44.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:44 smithi063 bash[35391]: cluster 2024-02-22T19:14:44.121941+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-02-22T19:14:44.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:44 smithi063 bash[35391]: cluster 2024-02-22T19:14:44.121993+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-22T19:14:44.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:44 smithi063 bash[35391]: cluster 2024-02-22T19:14:44.123022+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e24: y(active, since 39s), standbys: x 2024-02-22T19:14:44.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:44 smithi063 bash[35391]: cluster 2024-02-22T19:14:44.123481+0000 mon.a (mon.0) 7 : cluster [INF] overall HEALTH_OK 2024-02-22T19:14:44.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:44 smithi063 bash[35391]: cluster 2024-02-22T19:14:44.132054+0000 mon.a (mon.0) 8 : cluster [DBG] mgrmap e25: y(active, since 39s), standbys: x 2024-02-22T19:14:44.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:44 smithi063 bash[35391]: audit 2024-02-22T19:14:44.139826+0000 mon.a (mon.0) 9 : audit [INF] from='mgr.24811 ' entity='' 2024-02-22T19:14:44.484 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: ignoring --setuser ceph since I am not root 2024-02-22T19:14:44.484 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: ignoring --setgroup ceph since I am not root 2024-02-22T19:14:44.484 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:44.181+0000 7f84a2c35700 1 -- 172.21.15.62:0/820112190 <== mon.0 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561728e3c4e0 con 0x561728e12c00 2024-02-22T19:14:44.484 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:44.314+0000 7f84b2e12680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-22T19:14:44.484 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:44.400+0000 7f84b2e12680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-22T19:14:44.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:40.713575+0000 mgr.y (mgr.24811) 27 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:44.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:42.714107+0000 mgr.y (mgr.24811) 28 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:44.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:42.755888+0000 mon.c (mon.1) 132 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 425197568, \"cpu_percentage\": \"54.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:15.424285Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102770933, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424431Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48769269, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424576Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48570040, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424719Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42289070, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424862Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44868567, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425002Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13914603, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425135Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:15.425277Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35190210, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425406Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvm 2024-02-22T19:14:44.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:44 smithi062 bash[67442]: cluster 2024-02-22T19:14:40.713575+0000 mgr.y (mgr.24811) 27 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:44.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:44 smithi062 bash[67442]: cluster 2024-02-22T19:14:42.714107+0000 mgr.y (mgr.24811) 28 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:44.486 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: e0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:39.119299Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:44.486 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:44.103562+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2024-02-22T19:14:44.486 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:44.117371+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-22T19:14:44.486 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:44.121341+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0],b=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],c=[v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0]} removed_ranks: {} 2024-02-22T19:14:44.486 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:44.121941+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-02-22T19:14:44.486 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:44.121993+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-22T19:14:44.486 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:44.123022+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e24: y(active, since 39s), standbys: x 2024-02-22T19:14:44.486 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:44.123481+0000 mon.a (mon.0) 7 : cluster [INF] overall HEALTH_OK 2024-02-22T19:14:44.486 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:44.132054+0000 mon.a (mon.0) 8 : cluster [DBG] mgrmap e25: y(active, since 39s), standbys: x 2024-02-22T19:14:44.486 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:44.139826+0000 mon.a (mon.0) 9 : audit [INF] from='mgr.24811 ' entity='' 2024-02-22T19:14:44.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:44 smithi062 bash[67442]: audit 2024-02-22T19:14:42.755888+0000 mon.c (mon.1) 132 : audit [INF] from='mgr.24811 172.21.15.62:0/1948619470' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi062","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi062\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi062\", \"container_id\": \"0310c48cbf40\", \"container_image_id\": \"7403d18623076b313def53d9a4ae24b05fb9f62358c436a81c22d7e96d9d9550\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:44277403522cf37edeee63b04643fd6c6e9416f13c3731a771e3cc8e53b7d010\"], \"memory_usage\": 425197568, \"cpu_percentage\": \"54.54%\", \"version\": \"16.2.14-550-geb66ed92\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-22T19:14:15.424285Z\", \"created\": \"2024-02-22T19:02:50.704838Z\", \"started\": \"2024-02-22T19:13:57.584085Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi062\", \"container_id\": \"921b06886416\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 102770933, \"cpu_percentage\": \"0.82%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424431Z\", \"created\": \"2024-02-22T19:04:13.478486Z\", \"started\": \"2024-02-22T19:04:13.513746Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi062\", \"container_id\": \"e651beecc87d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48769269, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424576Z\", \"created\": \"2024-02-22T19:05:07.425639Z\", \"started\": \"2024-02-22T19:05:10.108570Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi062\", \"container_id\": \"d7a667155c4b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48570040, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424719Z\", \"created\": \"2024-02-22T19:05:27.833320Z\", \"started\": \"2024-02-22T19:05:29.464787Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi062\", \"container_id\": \"dc5ec198f96d\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42289070, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.424862Z\", \"created\": \"2024-02-22T19:05:46.128031Z\", \"started\": \"2024-02-22T19:05:48.339230Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi062\", \"container_id\": \"efb44063d52f\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44868567, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425002Z\", \"created\": \"2024-02-22T19:06:04.783735Z\", \"started\": \"2024-02-22T19:06:07.096445Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi062\", \"container_id\": \"3e27c560bf7f\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13914603, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425135Z\", \"created\": \"2024-02-22T19:07:53.457021Z\", \"started\": \"2024-02-22T19:08:03.594719Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi062\", \"container_id\": \"61d969d05cbc\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 17301504, \"cpu_percentage\": \"0.36%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-22T19:14:15.425277Z\", \"created\": \"2024-02-22T19:08:09.303770Z\", \"started\": \"2024-02-22T19:13:29.434115Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi062.zxmpna\", \"daemon_name\": \"rgw.r.z.smithi062.zxmpna\", \"hostname\": \"smithi062\", \"container_id\": \"45553891c2c4\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 35190210, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-22T19:14:15.425406Z\", \"created\": \"2024-02-22T19:09:27.756525Z\", \"started\": \"2024-02-22T19:09:27.790468Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665763Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"ed642f1e-2a27-46e6-a7e2-dba0a3ccb432\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"RCcgFi-zVhd-cVi6-n40k-6IB7-a8CZ-TctYVj\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5d915b66-d47b-4dd0-a6c4-7144de928112\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"3k39eN-eFlA-z4fG-pPFk-OpzS-p2bO-KzH9Fk\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"85b86909-3c43-46e4-8bc0-d4d3f86cb85a\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"tiV8EC-PrKe-dK27-cjFY-8TOj-bpYe-t1LMKv\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"87d57bdc-86cc-4aa2-9d2f-4dbc6a3d16f2\", \"cluster_fsid\": \"e2bc0d14-d1b4-11ee-95bf-87774f69a715\", \"block_uuid\": \"evJYVz-r0tm-mTdd-2YHS-osbH-zA3W-TO5WfM\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_CVFT53440094400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-22T19:13:01.665775Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4W5SV\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:19.990381Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-22T19:13:44.414027Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:05.798354Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:26.213151Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-22T19:05:44.462768Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-22T19:06:03.146334Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:07:52.707267Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-22T19:13:21.465049Z\"}, \"rgw.r.z.smithi062.zxmpna\": {\"deps\": [], \"last_config\": \"2024-02-22T19:09:25.979733Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-22T19:14:39.119299Z\"}}, \"last_device_update\": \"2024-02-22T19:06:10.932080Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-22T19:13:58.798269Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-22T19:14:44.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:44 smithi062 bash[67442]: cluster 2024-02-22T19:14:44.103562+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2024-02-22T19:14:44.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:44 smithi062 bash[67442]: cluster 2024-02-22T19:14:44.117371+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-22T19:14:44.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:44 smithi062 bash[67442]: cluster 2024-02-22T19:14:44.121341+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0],b=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],c=[v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0]} removed_ranks: {} 2024-02-22T19:14:44.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:44 smithi062 bash[67442]: cluster 2024-02-22T19:14:44.121941+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-02-22T19:14:44.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:44 smithi062 bash[67442]: cluster 2024-02-22T19:14:44.121993+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-22T19:14:44.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:44 smithi062 bash[67442]: cluster 2024-02-22T19:14:44.123022+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e24: y(active, since 39s), standbys: x 2024-02-22T19:14:44.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:44 smithi062 bash[67442]: cluster 2024-02-22T19:14:44.123481+0000 mon.a (mon.0) 7 : cluster [INF] overall HEALTH_OK 2024-02-22T19:14:44.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:44 smithi062 bash[67442]: cluster 2024-02-22T19:14:44.132054+0000 mon.a (mon.0) 8 : cluster [DBG] mgrmap e25: y(active, since 39s), standbys: x 2024-02-22T19:14:44.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:44 smithi062 bash[67442]: audit 2024-02-22T19:14:44.139826+0000 mon.a (mon.0) 9 : audit [INF] from='mgr.24811 ' entity='' 2024-02-22T19:14:45.213 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:44 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:44.771+0000 7f8ff4885680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-22T19:14:45.234 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:44.785+0000 7f84b2e12680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-22T19:14:45.877 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:45 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:45.569+0000 7f8ff4885680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-22T19:14:45.877 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:45 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:45.653+0000 7f8ff4885680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-22T19:14:45.894 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:45 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:45.588+0000 7f84b2e12680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-22T19:14:45.894 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:45 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:45.671+0000 7f84b2e12680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-22T19:14:46.135 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:45 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:45.875+0000 7f8ff4885680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-22T19:14:46.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:46 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:45.133321+0000 mon.a (mon.0) 10 : cluster [DBG] mgrmap e26: y(active, since 40s), standbys: x 2024-02-22T19:14:46.234 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:45 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:45.894+0000 7f84b2e12680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-22T19:14:46.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:46 smithi062 bash[67442]: cluster 2024-02-22T19:14:45.133321+0000 mon.a (mon.0) 10 : cluster [DBG] mgrmap e26: y(active, since 40s), standbys: x 2024-02-22T19:14:46.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:46 smithi063 bash[35391]: cluster 2024-02-22T19:14:45.133321+0000 mon.a (mon.0) 10 : cluster [DBG] mgrmap e26: y(active, since 40s), standbys: x 2024-02-22T19:14:47.184 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:46 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:46.868+0000 7f8ff4885680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-22T19:14:47.184 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:47 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:47.004+0000 7f8ff4885680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-22T19:14:47.184 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:47 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:47.088+0000 7f8ff4885680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-22T19:14:47.184 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:47 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:47.183+0000 7f8ff4885680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-22T19:14:47.208 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:46 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:46.886+0000 7f84b2e12680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-22T19:14:47.208 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:47 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:47.024+0000 7f84b2e12680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-22T19:14:47.208 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:47 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:47.111+0000 7f84b2e12680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-22T19:14:47.463 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:47 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:47.386+0000 7f8ff4885680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-22T19:14:47.484 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:47 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:47.207+0000 7f84b2e12680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-22T19:14:47.484 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:47 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:47.412+0000 7f84b2e12680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-22T19:14:47.963 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:47 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:47.684+0000 7f8ff4885680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-22T19:14:47.963 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:47 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:47.788+0000 7f8ff4885680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-22T19:14:47.984 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:47 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:47.714+0000 7f84b2e12680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-22T19:14:47.984 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:47 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:47.817+0000 7f84b2e12680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-22T19:14:48.928 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:48 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:48.557+0000 7f8ff4885680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-22T19:14:48.928 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:48 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:48.646+0000 7f8ff4885680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-22T19:14:48.928 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:48 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:48.743+0000 7f8ff4885680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-22T19:14:48.955 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:48 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:48.585+0000 7f84b2e12680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-22T19:14:48.955 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:48 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:48.672+0000 7f84b2e12680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-22T19:14:48.955 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:48 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:48.770+0000 7f84b2e12680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-22T19:14:49.225 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:48 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:48.954+0000 7f84b2e12680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-22T19:14:49.463 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:48 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:48.927+0000 7f8ff4885680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-22T19:14:49.463 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:49 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:49.195+0000 7f8ff4885680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-22T19:14:49.463 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:49 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:49.335+0000 7f8ff4885680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-22T19:14:49.484 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:49.225+0000 7f84b2e12680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-22T19:14:49.484 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:49.365+0000 7f84b2e12680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-22T19:14:49.747 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:49 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:49.476+0000 7f8ff4885680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-22T19:14:49.747 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:49 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:49.658+0000 7f8ff4885680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-22T19:14:49.782 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:49.508+0000 7f84b2e12680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-22T19:14:49.782 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:49.692+0000 7f84b2e12680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-22T19:14:50.213 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:14:49 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x[52165]: debug 2024-02-22T19:14:49.746+0000 7f8ff4885680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-22T19:14:50.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:49 smithi063 bash[35391]: cluster 2024-02-22T19:14:49.760674+0000 mon.a (mon.0) 11 : cluster [DBG] Standby manager daemon x restarted 2024-02-22T19:14:50.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:49 smithi063 bash[35391]: cluster 2024-02-22T19:14:49.760757+0000 mon.a (mon.0) 12 : cluster [DBG] Standby manager daemon x started 2024-02-22T19:14:50.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:49 smithi063 bash[35391]: audit 2024-02-22T19:14:49.761526+0000 mon.b (mon.2) 168 : audit [DBG] from='mgr.? 172.21.15.63:0/699027911' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T19:14:50.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:49 smithi063 bash[35391]: audit 2024-02-22T19:14:49.762325+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.? 172.21.15.63:0/699027911' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:14:50.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:49 smithi063 bash[35391]: audit 2024-02-22T19:14:49.763186+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.? 172.21.15.63:0/699027911' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T19:14:50.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:49 smithi063 bash[35391]: audit 2024-02-22T19:14:49.763429+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.? 172.21.15.63:0/699027911' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:14:50.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:49 smithi063 bash[35391]: cluster 2024-02-22T19:14:49.796036+0000 mon.a (mon.0) 13 : cluster [INF] Active manager daemon y restarted 2024-02-22T19:14:50.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:49 smithi063 bash[35391]: cluster 2024-02-22T19:14:49.796307+0000 mon.a (mon.0) 14 : cluster [INF] Activating manager daemon y 2024-02-22T19:14:50.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:49 smithi063 bash[35391]: cluster 2024-02-22T19:14:49.801243+0000 mon.a (mon.0) 15 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-22T19:14:50.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:49 smithi063 bash[35391]: cluster 2024-02-22T19:14:49.801847+0000 mon.a (mon.0) 16 : cluster [DBG] mgrmap e27: y(active, starting, since 0.00560341s), standbys: x 2024-02-22T19:14:50.234 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:49.782+0000 7f84b2e12680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-22T19:14:50.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:49 smithi062 bash[67442]: cluster 2024-02-22T19:14:49.760674+0000 mon.a (mon.0) 11 : cluster [DBG] Standby manager daemon x restarted 2024-02-22T19:14:50.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:49 smithi062 bash[67442]: cluster 2024-02-22T19:14:49.760757+0000 mon.a (mon.0) 12 : cluster [DBG] Standby manager daemon x started 2024-02-22T19:14:50.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:49 smithi062 bash[67442]: audit 2024-02-22T19:14:49.761526+0000 mon.b (mon.2) 168 : audit [DBG] from='mgr.? 172.21.15.63:0/699027911' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T19:14:50.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:49 smithi062 bash[67442]: audit 2024-02-22T19:14:49.762325+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.? 172.21.15.63:0/699027911' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:14:50.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:49 smithi062 bash[67442]: audit 2024-02-22T19:14:49.763186+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.? 172.21.15.63:0/699027911' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T19:14:50.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:49 smithi062 bash[67442]: audit 2024-02-22T19:14:49.763429+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.? 172.21.15.63:0/699027911' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:14:50.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:49 smithi062 bash[67442]: cluster 2024-02-22T19:14:49.796036+0000 mon.a (mon.0) 13 : cluster [INF] Active manager daemon y restarted 2024-02-22T19:14:50.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:49 smithi062 bash[67442]: cluster 2024-02-22T19:14:49.796307+0000 mon.a (mon.0) 14 : cluster [INF] Activating manager daemon y 2024-02-22T19:14:50.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:49 smithi062 bash[67442]: cluster 2024-02-22T19:14:49.801243+0000 mon.a (mon.0) 15 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-22T19:14:50.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:49 smithi062 bash[67442]: cluster 2024-02-22T19:14:49.801847+0000 mon.a (mon.0) 16 : cluster [DBG] mgrmap e27: y(active, starting, since 0.00560341s), standbys: x 2024-02-22T19:14:50.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:49.760674+0000 mon.a (mon.0) 11 : cluster [DBG] Standby manager daemon x restarted 2024-02-22T19:14:50.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:49.760757+0000 mon.a (mon.0) 12 : cluster [DBG] Standby manager daemon x started 2024-02-22T19:14:50.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:49.761526+0000 mon.b (mon.2) 168 : audit [DBG] from='mgr.? 172.21.15.63:0/699027911' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-22T19:14:50.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:49.762325+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.? 172.21.15.63:0/699027911' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:14:50.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:49.763186+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.? 172.21.15.63:0/699027911' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-22T19:14:50.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:49.763429+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.? 172.21.15.63:0/699027911' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:14:50.236 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:49.796036+0000 mon.a (mon.0) 13 : cluster [INF] Active manager daemon y restarted 2024-02-22T19:14:50.236 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:49.796307+0000 mon.a (mon.0) 14 : cluster [INF] Activating manager daemon y 2024-02-22T19:14:50.236 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:49.801243+0000 mon.a (mon.0) 15 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-22T19:14:50.236 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:49.801847+0000 mon.a (mon.0) 16 : cluster [DBG] mgrmap e27: y(active, starting, since 0.00560341s), standbys: x 2024-02-22T19:14:55.910 INFO:teuthology.orchestra.run.smithi062.stderr:Error ENOTSUP: Warning: due to ceph-mgr restart, some PG states may not be up to date 2024-02-22T19:14:55.911 INFO:teuthology.orchestra.run.smithi062.stderr:Module 'orchestrator' is not enabled/loaded (required by command 'orch upgrade status'): use `ceph mgr module enable orchestrator` to enable it 2024-02-22T19:14:56.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.805531+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T19:14:56.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.805740+0000 mon.a (mon.0) 18 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T19:14:56.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.805883+0000 mon.a (mon.0) 19 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T19:14:56.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.807293+0000 mon.a (mon.0) 20 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T19:14:56.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.807526+0000 mon.a (mon.0) 21 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T19:14:56.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.807723+0000 mon.a (mon.0) 22 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:14:56.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.807964+0000 mon.a (mon.0) 23 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:14:56.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.808194+0000 mon.a (mon.0) 24 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:14:56.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.808581+0000 mon.a (mon.0) 25 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:14:56.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.808938+0000 mon.a (mon.0) 26 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:14:56.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.809295+0000 mon.a (mon.0) 27 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:14:56.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.809658+0000 mon.a (mon.0) 28 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:14:56.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.809972+0000 mon.a (mon.0) 29 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:14:56.112 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.810199+0000 mon.a (mon.0) 30 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T19:14:56.112 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.810405+0000 mon.a (mon.0) 31 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T19:14:56.112 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:55.905+0000 7f84665ff700 -1 mgr.server reply reply (95) Operation not supported Warning: due to ceph-mgr restart, some PG states may not be up to date 2024-02-22T19:14:56.112 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: Module 'orchestrator' is not enabled/loaded (required by command 'orch upgrade status'): use `ceph mgr module enable orchestrator` to enable it 2024-02-22T19:14:56.112 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:14:55.906+0000 7f84665ff700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-02-22T19:14:56.112 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:56 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: [79B blob data] 2024-02-22T19:14:56.112 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:14:56 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: [79B blob data] 2024-02-22T19:14:56.112 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.805531+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T19:14:56.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.805740+0000 mon.a (mon.0) 18 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T19:14:56.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.805883+0000 mon.a (mon.0) 19 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T19:14:56.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.807293+0000 mon.a (mon.0) 20 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T19:14:56.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.807526+0000 mon.a (mon.0) 21 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T19:14:56.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.807723+0000 mon.a (mon.0) 22 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:14:56.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.807964+0000 mon.a (mon.0) 23 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:14:56.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.808194+0000 mon.a (mon.0) 24 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:14:56.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.808581+0000 mon.a (mon.0) 25 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:14:56.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.808938+0000 mon.a (mon.0) 26 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:14:56.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.809295+0000 mon.a (mon.0) 27 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:14:56.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.809658+0000 mon.a (mon.0) 28 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:14:56.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.809972+0000 mon.a (mon.0) 29 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:14:56.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.810199+0000 mon.a (mon.0) 30 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T19:14:56.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.810405+0000 mon.a (mon.0) 31 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T19:14:56.113 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.810876+0000 mon.a (mon.0) 32 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T19:14:56.114 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.811757+0000 mon.a (mon.0) 33 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T19:14:56.114 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.812721+0000 mon.a (mon.0) 34 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-22T19:14:56.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.810876+0000 mon.a (mon.0) 32 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T19:14:56.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.811757+0000 mon.a (mon.0) 33 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T19:14:56.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.812721+0000 mon.a (mon.0) 34 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-22T19:14:56.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.813089+0000 mon.a (mon.0) 35 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T19:14:56.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.813431+0000 mon.a (mon.0) 36 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T19:14:56.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.813798+0000 mon.a (mon.0) 37 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi062"}]: dispatch 2024-02-22T19:14:56.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.814171+0000 mon.a (mon.0) 38 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi063"}]: dispatch 2024-02-22T19:14:56.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.814537+0000 mon.a (mon.0) 39 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T19:14:56.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.814892+0000 mon.a (mon.0) 40 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-22T19:14:56.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.815231+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T19:14:56.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.815571+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T19:14:56.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.815927+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T19:14:56.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.816285+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T19:14:56.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.816601+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T19:14:56.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.816940+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T19:14:56.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.817281+0000 mon.a (mon.0) 47 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T19:14:56.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.817620+0000 mon.a (mon.0) 48 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T19:14:56.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.818025+0000 mon.a (mon.0) 49 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-22T19:14:56.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.818454+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T19:14:56.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.818835+0000 mon.a (mon.0) 51 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:14:56.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.819221+0000 mon.a (mon.0) 52 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:14:56.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.819704+0000 mon.a (mon.0) 53 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T19:14:56.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.820044+0000 mon.a (mon.0) 54 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T19:14:56.116 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.820422+0000 mon.a (mon.0) 55 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T19:14:56.116 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.820805+0000 mon.a (mon.0) 56 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T19:14:56.116 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:55.844107+0000 mon.a (mon.0) 57 : cluster [INF] Manager daemon y is now available 2024-02-22T19:14:56.116 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.813089+0000 mon.a (mon.0) 35 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T19:14:56.116 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.813431+0000 mon.a (mon.0) 36 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T19:14:56.116 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.813798+0000 mon.a (mon.0) 37 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi062"}]: dispatch 2024-02-22T19:14:56.116 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.814171+0000 mon.a (mon.0) 38 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi063"}]: dispatch 2024-02-22T19:14:56.116 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.814537+0000 mon.a (mon.0) 39 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T19:14:56.116 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.814892+0000 mon.a (mon.0) 40 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-22T19:14:56.116 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.815231+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T19:14:56.117 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.815571+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T19:14:56.117 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.815927+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T19:14:56.117 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.816285+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T19:14:56.117 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.816601+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T19:14:56.117 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.816940+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T19:14:56.117 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.817281+0000 mon.a (mon.0) 47 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T19:14:56.117 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.817620+0000 mon.a (mon.0) 48 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T19:14:56.117 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.818025+0000 mon.a (mon.0) 49 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-22T19:14:56.117 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.818454+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T19:14:56.117 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.818835+0000 mon.a (mon.0) 51 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:14:56.117 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.819221+0000 mon.a (mon.0) 52 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:14:56.117 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.819704+0000 mon.a (mon.0) 53 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T19:14:56.117 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.820044+0000 mon.a (mon.0) 54 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T19:14:56.117 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.820422+0000 mon.a (mon.0) 55 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T19:14:56.117 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: audit 2024-02-22T19:14:55.820805+0000 mon.a (mon.0) 56 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T19:14:56.117 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:55 smithi062 bash[67442]: cluster 2024-02-22T19:14:55.844107+0000 mon.a (mon.0) 57 : cluster [INF] Manager daemon y is now available 2024-02-22T19:14:56.118 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.805531+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T19:14:56.118 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.805740+0000 mon.a (mon.0) 18 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T19:14:56.118 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.805883+0000 mon.a (mon.0) 19 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T19:14:56.118 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.807293+0000 mon.a (mon.0) 20 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-22T19:14:56.118 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.807526+0000 mon.a (mon.0) 21 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-22T19:14:56.118 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.807723+0000 mon.a (mon.0) 22 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:14:56.118 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.807964+0000 mon.a (mon.0) 23 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-22T19:14:56.118 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.808194+0000 mon.a (mon.0) 24 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-22T19:14:56.118 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.808581+0000 mon.a (mon.0) 25 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-22T19:14:56.119 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.808938+0000 mon.a (mon.0) 26 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-22T19:14:56.119 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.809295+0000 mon.a (mon.0) 27 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-22T19:14:56.119 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.809658+0000 mon.a (mon.0) 28 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-22T19:14:56.119 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.809972+0000 mon.a (mon.0) 29 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-22T19:14:56.119 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.810199+0000 mon.a (mon.0) 30 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-22T19:14:56.119 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.810405+0000 mon.a (mon.0) 31 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-22T19:14:56.119 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.810876+0000 mon.a (mon.0) 32 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-22T19:14:56.119 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.811757+0000 mon.a (mon.0) 33 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-22T19:14:56.119 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.812721+0000 mon.a (mon.0) 34 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-22T19:14:56.119 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.813089+0000 mon.a (mon.0) 35 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-22T19:14:56.119 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.813431+0000 mon.a (mon.0) 36 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-22T19:14:56.119 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.813798+0000 mon.a (mon.0) 37 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi062"}]: dispatch 2024-02-22T19:14:56.119 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.814171+0000 mon.a (mon.0) 38 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi063"}]: dispatch 2024-02-22T19:14:56.119 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.814537+0000 mon.a (mon.0) 39 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-22T19:14:56.119 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.814892+0000 mon.a (mon.0) 40 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-22T19:14:56.119 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.815231+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-22T19:14:56.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.815571+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-22T19:14:56.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.815927+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-22T19:14:56.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.816285+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-22T19:14:56.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.816601+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-22T19:14:56.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.816940+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-22T19:14:56.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.817281+0000 mon.a (mon.0) 47 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-22T19:14:56.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.817620+0000 mon.a (mon.0) 48 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-22T19:14:56.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.818025+0000 mon.a (mon.0) 49 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-22T19:14:56.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.818454+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-22T19:14:56.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.818835+0000 mon.a (mon.0) 51 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-22T19:14:56.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.819221+0000 mon.a (mon.0) 52 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-22T19:14:56.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.819704+0000 mon.a (mon.0) 53 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-22T19:14:56.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.820044+0000 mon.a (mon.0) 54 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-22T19:14:56.120 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.820422+0000 mon.a (mon.0) 55 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-22T19:14:56.121 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: audit 2024-02-22T19:14:55.820805+0000 mon.a (mon.0) 56 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-22T19:14:56.121 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:55 smithi063 bash[35391]: cluster 2024-02-22T19:14:55.844107+0000 mon.a (mon.0) 57 : cluster [INF] Manager daemon y is now available 2024-02-22T19:14:56.668 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph orch ps' 2024-02-22T19:14:56.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:56 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:55.901361+0000 mon.a (mon.0) 58 : cluster [DBG] mgrmap e28: y(active, since 6s), standbys: x 2024-02-22T19:14:56.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:56 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.906523+0000 mgr.y (mgr.24871) 1 : audit [DBG] from='client.44112 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:14:56.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:56 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:55.909307+0000 mgr.y (mgr.24871) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:56.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:56 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.968873+0000 mon.a (mon.0) 59 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:56.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:56 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:55.970198+0000 mon.a (mon.0) 60 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:56.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:56 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:56.019633+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:14:56.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:56 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:56.024425+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T19:14:56.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:56 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:56.250628+0000 mon.a (mon.0) 63 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:14:56.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:56 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:56.269791+0000 mon.a (mon.0) 64 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:14:56.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:56 smithi062 bash[67442]: cluster 2024-02-22T19:14:55.901361+0000 mon.a (mon.0) 58 : cluster [DBG] mgrmap e28: y(active, since 6s), standbys: x 2024-02-22T19:14:56.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:56 smithi062 bash[67442]: audit 2024-02-22T19:14:55.906523+0000 mgr.y (mgr.24871) 1 : audit [DBG] from='client.44112 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:14:56.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:56 smithi062 bash[67442]: cluster 2024-02-22T19:14:55.909307+0000 mgr.y (mgr.24871) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:56.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:56 smithi062 bash[67442]: audit 2024-02-22T19:14:55.968873+0000 mon.a (mon.0) 59 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:56.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:56 smithi062 bash[67442]: audit 2024-02-22T19:14:55.970198+0000 mon.a (mon.0) 60 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:56.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:56 smithi062 bash[67442]: audit 2024-02-22T19:14:56.019633+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:14:56.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:56 smithi062 bash[67442]: audit 2024-02-22T19:14:56.024425+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T19:14:56.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:56 smithi062 bash[67442]: audit 2024-02-22T19:14:56.250628+0000 mon.a (mon.0) 63 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:14:56.986 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:56 smithi062 bash[67442]: audit 2024-02-22T19:14:56.269791+0000 mon.a (mon.0) 64 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:14:57.203 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:56 smithi063 bash[35391]: cluster 2024-02-22T19:14:55.901361+0000 mon.a (mon.0) 58 : cluster [DBG] mgrmap e28: y(active, since 6s), standbys: x 2024-02-22T19:14:57.203 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:56 smithi063 bash[35391]: audit 2024-02-22T19:14:55.906523+0000 mgr.y (mgr.24871) 1 : audit [DBG] from='client.44112 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:14:57.203 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:56 smithi063 bash[35391]: cluster 2024-02-22T19:14:55.909307+0000 mgr.y (mgr.24871) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:57.203 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:56 smithi063 bash[35391]: audit 2024-02-22T19:14:55.968873+0000 mon.a (mon.0) 59 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:57.203 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:56 smithi063 bash[35391]: audit 2024-02-22T19:14:55.970198+0000 mon.a (mon.0) 60 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:14:57.203 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:56 smithi063 bash[35391]: audit 2024-02-22T19:14:56.019633+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-22T19:14:57.203 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:56 smithi063 bash[35391]: audit 2024-02-22T19:14:56.024425+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-22T19:14:57.203 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:56 smithi063 bash[35391]: audit 2024-02-22T19:14:56.250628+0000 mon.a (mon.0) 63 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:14:57.203 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:56 smithi063 bash[35391]: audit 2024-02-22T19:14:56.269791+0000 mon.a (mon.0) 64 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:14:58.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:58 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:57.809280+0000 mgr.y (mgr.24871) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:58.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:58 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:57.908879+0000 mon.a (mon.0) 65 : cluster [DBG] mgrmap e29: y(active, since 8s), standbys: x 2024-02-22T19:14:58.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:58 smithi062 bash[67442]: cluster 2024-02-22T19:14:57.809280+0000 mgr.y (mgr.24871) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:58.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:58 smithi062 bash[67442]: cluster 2024-02-22T19:14:57.908879+0000 mon.a (mon.0) 65 : cluster [DBG] mgrmap e29: y(active, since 8s), standbys: x 2024-02-22T19:14:59.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:58 smithi063 bash[35391]: cluster 2024-02-22T19:14:57.809280+0000 mgr.y (mgr.24871) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:14:59.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:58 smithi063 bash[35391]: cluster 2024-02-22T19:14:57.908879+0000 mon.a (mon.0) 65 : cluster [DBG] mgrmap e29: y(active, since 8s), standbys: x 2024-02-22T19:14:59.214 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T19:14:59.214 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.a smithi062 running (89s) 43s ago 6m 16.5M - 0.26.0 9f27df16978d 61d969d05cbc 2024-02-22T19:14:59.214 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.a smithi063 running (6m) 21s ago 6m 30.2M - 6.6.2 87a51ecf0b1c 9863e2980fa6 2024-02-22T19:14:59.214 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.x smithi063 *:8443 running (27s) 21s ago 10m 41.0M - 16.2.14-550-geb66ed92 7403d1862307 6d5a1e303e09 2024-02-22T19:14:59.214 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.y smithi062 *:8443 running (61s) 43s ago 12m 405M - 16.2.14-550-geb66ed92 7403d1862307 0310c48cbf40 2024-02-22T19:14:59.214 INFO:teuthology.orchestra.run.smithi062.stdout:mon.a smithi062 starting - - - 2048M 2024-02-22T19:14:59.215 INFO:teuthology.orchestra.run.smithi062.stdout:mon.b smithi063 running (10m) 21s ago 10m 97.2M 2048M 15.2.0 204a01f9b0b6 deb740d884ca 2024-02-22T19:14:59.215 INFO:teuthology.orchestra.run.smithi062.stdout:mon.c smithi062 running (10m) 43s ago 10m 98.0M 2048M 15.2.0 204a01f9b0b6 921b06886416 2024-02-22T19:14:59.215 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.a smithi062 running (6m) 43s ago 7m 13.2M - 1.7.0 72c9c2088986 3e27c560bf7f 2024-02-22T19:14:59.215 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.b smithi063 running (6m) 21s ago 7m 13.0M - 1.7.0 72c9c2088986 ab2867e3fd57 2024-02-22T19:14:59.215 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (9m) 43s ago 9m 46.5M 4096M 15.2.0 204a01f9b0b6 e651beecc87d 2024-02-22T19:14:59.215 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (9m) 43s ago 9m 46.3M 4096M 15.2.0 204a01f9b0b6 d7a667155c4b 2024-02-22T19:14:59.215 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (9m) 43s ago 9m 40.3M 4096M 15.2.0 204a01f9b0b6 dc5ec198f96d 2024-02-22T19:14:59.215 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi062 running (8m) 43s ago 8m 42.7M 4096M 15.2.0 204a01f9b0b6 efb44063d52f 2024-02-22T19:14:59.215 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi063 running (8m) 21s ago 8m 44.1M 4096M 15.2.0 204a01f9b0b6 0affbe803c22 2024-02-22T19:14:59.215 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi063 running (8m) 21s ago 8m 42.3M 4096M 15.2.0 204a01f9b0b6 636665ed6108 2024-02-22T19:14:59.215 INFO:teuthology.orchestra.run.smithi062.stdout:osd.6 smithi063 running (7m) 21s ago 7m 41.9M 4096M 15.2.0 204a01f9b0b6 8c48e05bc7dd 2024-02-22T19:14:59.215 INFO:teuthology.orchestra.run.smithi062.stdout:osd.7 smithi063 running (7m) 21s ago 7m 44.3M 4096M 15.2.0 204a01f9b0b6 c298ad18c8bb 2024-02-22T19:14:59.215 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.a smithi063 running (78s) 21s ago 7m 33.5M - 2.50.0 38c53d8da784 564ec2e44075 2024-02-22T19:14:59.215 INFO:teuthology.orchestra.run.smithi062.stdout:rgw.r.z.smithi062.zxmpna smithi062 running (5m) 43s ago 5m 33.5M - 15.2.0 204a01f9b0b6 45553891c2c4 2024-02-22T19:14:59.215 INFO:teuthology.orchestra.run.smithi062.stdout:rgw.r.z.smithi063.feyald smithi063 running (5m) 21s ago 5m 32.5M - 15.2.0 204a01f9b0b6 478364f15ee3 2024-02-22T19:14:59.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:59 smithi062 bash[67442]: audit 2024-02-22T19:14:59.203935+0000 mon.a (mon.0) 66 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:14:59.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:59 smithi062 bash[67442]: audit 2024-02-22T19:14:59.204373+0000 mon.a (mon.0) 67 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:14:59.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:59 smithi062 bash[67442]: audit 2024-02-22T19:14:59.204719+0000 mon.a (mon.0) 68 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:59.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:59 smithi062 bash[67442]: audit 2024-02-22T19:14:59.205086+0000 mon.a (mon.0) 69 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:59.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:59 smithi062 bash[67442]: audit 2024-02-22T19:14:59.205435+0000 mon.a (mon.0) 70 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:59.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:59 smithi062 bash[67442]: audit 2024-02-22T19:14:59.205797+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:59.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:59 smithi062 bash[67442]: audit 2024-02-22T19:14:59.207523+0000 mon.a (mon.0) 72 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:14:59.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:59 smithi062 bash[67442]: audit 2024-02-22T19:14:59.207871+0000 mon.a (mon.0) 73 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:59.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:59 smithi062 bash[67442]: audit 2024-02-22T19:14:59.208233+0000 mon.a (mon.0) 74 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:59.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:59 smithi062 bash[67442]: audit 2024-02-22T19:14:59.208569+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:59.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:14:59 smithi062 bash[67442]: audit 2024-02-22T19:14:59.208897+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:59.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:59 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:59.203935+0000 mon.a (mon.0) 66 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:14:59.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:59 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:59.204373+0000 mon.a (mon.0) 67 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:14:59.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:59 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:59.204719+0000 mon.a (mon.0) 68 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:59.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:59 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:59.205086+0000 mon.a (mon.0) 69 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:59.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:59 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:59.205435+0000 mon.a (mon.0) 70 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:59.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:59 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:59.205797+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:59.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:59 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:59.207523+0000 mon.a (mon.0) 72 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:14:59.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:59 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:59.207871+0000 mon.a (mon.0) 73 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:59.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:59 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:59.208233+0000 mon.a (mon.0) 74 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:59.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:59 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:59.208569+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:14:59.986 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:14:59 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:59.208897+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:00.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:59 smithi063 bash[35391]: audit 2024-02-22T19:14:59.203935+0000 mon.a (mon.0) 66 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:15:00.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:59 smithi063 bash[35391]: audit 2024-02-22T19:14:59.204373+0000 mon.a (mon.0) 67 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:15:00.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:59 smithi063 bash[35391]: audit 2024-02-22T19:14:59.204719+0000 mon.a (mon.0) 68 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:00.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:59 smithi063 bash[35391]: audit 2024-02-22T19:14:59.205086+0000 mon.a (mon.0) 69 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:00.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:59 smithi063 bash[35391]: audit 2024-02-22T19:14:59.205435+0000 mon.a (mon.0) 70 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:00.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:59 smithi063 bash[35391]: audit 2024-02-22T19:14:59.205797+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:00.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:59 smithi063 bash[35391]: audit 2024-02-22T19:14:59.207523+0000 mon.a (mon.0) 72 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:15:00.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:59 smithi063 bash[35391]: audit 2024-02-22T19:14:59.207871+0000 mon.a (mon.0) 73 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:00.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:59 smithi063 bash[35391]: audit 2024-02-22T19:14:59.208233+0000 mon.a (mon.0) 74 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:00.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:59 smithi063 bash[35391]: audit 2024-02-22T19:14:59.208569+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:00.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:14:59 smithi063 bash[35391]: audit 2024-02-22T19:14:59.208897+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:00.324 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph versions' 2024-02-22T19:15:00.933 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:00 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:14:59.201857+0000 mgr.y (mgr.24871) 4 : audit [DBG] from='client.34748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:15:00.933 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:00 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:14:59.809890+0000 mgr.y (mgr.24871) 5 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:00.933 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:00 smithi062 bash[67442]: audit 2024-02-22T19:14:59.201857+0000 mgr.y (mgr.24871) 4 : audit [DBG] from='client.34748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:15:00.933 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:00 smithi062 bash[67442]: cluster 2024-02-22T19:14:59.809890+0000 mgr.y (mgr.24871) 5 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:01.091 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:00 smithi063 bash[35391]: audit 2024-02-22T19:14:59.201857+0000 mgr.y (mgr.24871) 4 : audit [DBG] from='client.34748 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:15:01.091 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:00 smithi063 bash[35391]: cluster 2024-02-22T19:14:59.809890+0000 mgr.y (mgr.24871) 5 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:02.445 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-22T19:15:02.445 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-02-22T19:15:02.445 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2024-02-22T19:15:02.445 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 1 2024-02-22T19:15:02.445 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:15:02.445 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-02-22T19:15:02.445 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T19:15:02.445 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:15:02.445 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-02-22T19:15:02.446 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-22T19:15:02.446 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:15:02.446 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": {}, 2024-02-22T19:15:02.446 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw": { 2024-02-22T19:15:02.446 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-22T19:15:02.446 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:15:02.446 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-02-22T19:15:02.446 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 12, 2024-02-22T19:15:02.446 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 3 2024-02-22T19:15:02.446 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-02-22T19:15:02.446 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-22T19:15:02.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:02 smithi063 bash[35391]: audit 2024-02-22T19:15:01.447325+0000 mon.a (mon.0) 77 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:02.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:02 smithi063 bash[35391]: audit 2024-02-22T19:15:01.738995+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:02.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:02 smithi063 bash[35391]: audit 2024-02-22T19:15:01.739450+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:02.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:02 smithi063 bash[35391]: audit 2024-02-22T19:15:01.739817+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:02.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:02 smithi063 bash[35391]: audit 2024-02-22T19:15:01.740098+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:02.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:02 smithi063 bash[35391]: audit 2024-02-22T19:15:01.740377+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:02.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:02 smithi063 bash[35391]: audit 2024-02-22T19:15:01.740672+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:02.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:02 smithi063 bash[35391]: audit 2024-02-22T19:15:01.741060+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:02.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:02 smithi063 bash[35391]: audit 2024-02-22T19:15:01.741501+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:02.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:02 smithi063 bash[35391]: audit 2024-02-22T19:15:01.741946+0000 mon.a (mon.0) 86 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:02.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:02 smithi063 bash[35391]: cluster 2024-02-22T19:15:01.810517+0000 mgr.y (mgr.24871) 6 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:02.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:02 smithi063 bash[35391]: audit 2024-02-22T19:15:02.444702+0000 mon.c (mon.1) 133 : audit [DBG] from='client.? 172.21.15.62:0/3905322199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:15:02.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:02 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:01.447325+0000 mon.a (mon.0) 77 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:02.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:02 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:01.738995+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:02.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:02 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:01.739450+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:02.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:02 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:01.739817+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:02.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:02 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:01.740098+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:02.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:02 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:01.740377+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:02.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:02 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:01.740672+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:02.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:02 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:01.741060+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:02.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:02 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:01.741501+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:02.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:02 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:01.741946+0000 mon.a (mon.0) 86 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:02.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:02 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:01.810517+0000 mgr.y (mgr.24871) 6 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:02.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:02 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:02.444702+0000 mon.c (mon.1) 133 : audit [DBG] from='client.? 172.21.15.62:0/3905322199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:15:02.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:02 smithi062 bash[67442]: audit 2024-02-22T19:15:01.447325+0000 mon.a (mon.0) 77 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:02.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:02 smithi062 bash[67442]: audit 2024-02-22T19:15:01.738995+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:02.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:02 smithi062 bash[67442]: audit 2024-02-22T19:15:01.739450+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:02.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:02 smithi062 bash[67442]: audit 2024-02-22T19:15:01.739817+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:02.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:02 smithi062 bash[67442]: audit 2024-02-22T19:15:01.740098+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:02.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:02 smithi062 bash[67442]: audit 2024-02-22T19:15:01.740377+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:02.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:02 smithi062 bash[67442]: audit 2024-02-22T19:15:01.740672+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:02.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:02 smithi062 bash[67442]: audit 2024-02-22T19:15:01.741060+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:02.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:02 smithi062 bash[67442]: audit 2024-02-22T19:15:01.741501+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:02.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:02 smithi062 bash[67442]: audit 2024-02-22T19:15:01.741946+0000 mon.a (mon.0) 86 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:02.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:02 smithi062 bash[67442]: cluster 2024-02-22T19:15:01.810517+0000 mgr.y (mgr.24871) 6 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:02.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:02 smithi062 bash[67442]: audit 2024-02-22T19:15:02.444702+0000 mon.c (mon.1) 133 : audit [DBG] from='client.? 172.21.15.62:0/3905322199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:15:03.346 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-02-22T19:15:05.102 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:03.810892+0000 mgr.y (mgr.24871) 7 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:05.102 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:04 smithi062 bash[67442]: cluster 2024-02-22T19:15:03.810892+0000 mgr.y (mgr.24871) 7 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:05.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:04 smithi063 bash[35391]: cluster 2024-02-22T19:15:03.810892+0000 mgr.y (mgr.24871) 7 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:05.300 INFO:teuthology.orchestra.run.smithi062.stdout:wait for servicemap items w/ changing names to refresh 2024-02-22T19:15:05.846 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'sleep 60' 2024-02-22T19:15:07.192 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:06 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:05.811255+0000 mgr.y (mgr.24871) 8 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:07.192 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:06 smithi062 bash[67442]: cluster 2024-02-22T19:15:05.811255+0000 mgr.y (mgr.24871) 8 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:07.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:06 smithi063 bash[35391]: cluster 2024-02-22T19:15:05.811255+0000 mgr.y (mgr.24871) 8 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:09.047 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:09 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:07.811832+0000 mgr.y (mgr.24871) 9 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:09.047 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:09 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:08.044467+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:09.047 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:09 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:08.325112+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:09.047 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:09 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:08.325492+0000 mon.a (mon.0) 89 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:09.047 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:09 smithi062 bash[67442]: cluster 2024-02-22T19:15:07.811832+0000 mgr.y (mgr.24871) 9 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:09.048 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:09 smithi062 bash[67442]: audit 2024-02-22T19:15:08.044467+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:09.048 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:09 smithi062 bash[67442]: audit 2024-02-22T19:15:08.325112+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:09.048 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:09 smithi062 bash[67442]: audit 2024-02-22T19:15:08.325492+0000 mon.a (mon.0) 89 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:09.048 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:09 smithi062 bash[67442]: audit 2024-02-22T19:15:08.325807+0000 mon.a (mon.0) 90 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:09.048 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:09 smithi062 bash[67442]: audit 2024-02-22T19:15:08.326077+0000 mon.a (mon.0) 91 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:09.048 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:09 smithi062 bash[67442]: audit 2024-02-22T19:15:08.326327+0000 mon.a (mon.0) 92 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:09.048 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:09 smithi062 bash[67442]: audit 2024-02-22T19:15:08.326575+0000 mon.a (mon.0) 93 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:09.048 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:09 smithi062 bash[67442]: audit 2024-02-22T19:15:08.326852+0000 mon.a (mon.0) 94 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:09.048 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:09 smithi062 bash[67442]: audit 2024-02-22T19:15:08.327106+0000 mon.a (mon.0) 95 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:09.048 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:09 smithi062 bash[67442]: audit 2024-02-22T19:15:08.327372+0000 mon.a (mon.0) 96 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:09.048 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:09 smithi062 bash[67442]: audit 2024-02-22T19:15:08.331195+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:09.048 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:09 smithi062 bash[67442]: audit 2024-02-22T19:15:08.336699+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:15:09.049 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:09 smithi062 bash[67442]: audit 2024-02-22T19:15:08.338877+0000 mon.a (mon.0) 99 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:15:09.049 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:09 smithi062 bash[67442]: audit 2024-02-22T19:15:08.339879+0000 mon.a (mon.0) 100 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-22T19:15:09.049 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:09 smithi062 bash[67442]: audit 2024-02-22T19:15:08.340506+0000 mon.a (mon.0) 101 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-02-22T19:15:09.374 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:09 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:08.325807+0000 mon.a (mon.0) 90 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:09.374 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:09 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:08.326077+0000 mon.a (mon.0) 91 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:09.374 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:09 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:08.326327+0000 mon.a (mon.0) 92 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:09.374 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:09 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:08.326575+0000 mon.a (mon.0) 93 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:09.374 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:09 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:08.326852+0000 mon.a (mon.0) 94 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:09.374 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:09 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:08.327106+0000 mon.a (mon.0) 95 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:09.374 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:09 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:08.327372+0000 mon.a (mon.0) 96 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:09.374 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:09 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:08.331195+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:09.374 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:09 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:08.336699+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:15:09.374 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:09 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:08.338877+0000 mon.a (mon.0) 99 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:15:09.374 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:09 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:08.339879+0000 mon.a (mon.0) 100 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-22T19:15:09.374 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:09 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:08.340506+0000 mon.a (mon.0) 101 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-02-22T19:15:09.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:09 smithi063 bash[35391]: cluster 2024-02-22T19:15:07.811832+0000 mgr.y (mgr.24871) 9 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:09.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:09 smithi063 bash[35391]: audit 2024-02-22T19:15:08.044467+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:09.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:09 smithi063 bash[35391]: audit 2024-02-22T19:15:08.325112+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:09.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:09 smithi063 bash[35391]: audit 2024-02-22T19:15:08.325492+0000 mon.a (mon.0) 89 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:09.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:09 smithi063 bash[35391]: audit 2024-02-22T19:15:08.325807+0000 mon.a (mon.0) 90 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:09.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:09 smithi063 bash[35391]: audit 2024-02-22T19:15:08.326077+0000 mon.a (mon.0) 91 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:09.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:09 smithi063 bash[35391]: audit 2024-02-22T19:15:08.326327+0000 mon.a (mon.0) 92 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:09.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:09 smithi063 bash[35391]: audit 2024-02-22T19:15:08.326575+0000 mon.a (mon.0) 93 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:09.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:09 smithi063 bash[35391]: audit 2024-02-22T19:15:08.326852+0000 mon.a (mon.0) 94 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:09.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:09 smithi063 bash[35391]: audit 2024-02-22T19:15:08.327106+0000 mon.a (mon.0) 95 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:15:09.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:09 smithi063 bash[35391]: audit 2024-02-22T19:15:08.327372+0000 mon.a (mon.0) 96 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-22T19:15:09.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:09 smithi063 bash[35391]: audit 2024-02-22T19:15:08.331195+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:09.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:09 smithi063 bash[35391]: audit 2024-02-22T19:15:08.336699+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:15:09.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:09 smithi063 bash[35391]: audit 2024-02-22T19:15:08.338877+0000 mon.a (mon.0) 99 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:15:09.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:09 smithi063 bash[35391]: audit 2024-02-22T19:15:08.339879+0000 mon.a (mon.0) 100 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-22T19:15:09.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:09 smithi063 bash[35391]: audit 2024-02-22T19:15:08.340506+0000 mon.a (mon.0) 101 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-02-22T19:15:10.392 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:10 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:08.340949+0000 mgr.y (mgr.24871) 10 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2024-02-22T19:15:10.392 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:10 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:09.726340+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:10.392 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:10 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:09.727246+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:15:10.392 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:10 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:09.727939+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:15:10.392 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:10 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:09.728511+0000 mon.a (mon.0) 105 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:10.392 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:10 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:09.729440+0000 mon.a (mon.0) 106 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-22T19:15:10.392 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:10 smithi062 bash[67442]: cephadm 2024-02-22T19:15:08.340949+0000 mgr.y (mgr.24871) 10 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2024-02-22T19:15:10.393 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:10 smithi062 bash[67442]: audit 2024-02-22T19:15:09.726340+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:10.393 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:10 smithi062 bash[67442]: audit 2024-02-22T19:15:09.727246+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:15:10.393 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:10 smithi062 bash[67442]: audit 2024-02-22T19:15:09.727939+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:15:10.393 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:10 smithi062 bash[67442]: audit 2024-02-22T19:15:09.728511+0000 mon.a (mon.0) 105 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:10.393 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:10 smithi062 bash[67442]: audit 2024-02-22T19:15:09.729440+0000 mon.a (mon.0) 106 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-22T19:15:10.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:10 smithi063 bash[35391]: cephadm 2024-02-22T19:15:08.340949+0000 mgr.y (mgr.24871) 10 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2024-02-22T19:15:10.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:10 smithi063 bash[35391]: audit 2024-02-22T19:15:09.726340+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:10.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:10 smithi063 bash[35391]: audit 2024-02-22T19:15:09.727246+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:15:10.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:10 smithi063 bash[35391]: audit 2024-02-22T19:15:09.727939+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:15:10.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:10 smithi063 bash[35391]: audit 2024-02-22T19:15:09.728511+0000 mon.a (mon.0) 105 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:10.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:10 smithi063 bash[35391]: audit 2024-02-22T19:15:09.729440+0000 mon.a (mon.0) 106 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-22T19:15:11.152 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:09.721592+0000 mgr.y (mgr.24871) 11 : cephadm [INF] Upgrade: Updating mon.c 2024-02-22T19:15:11.153 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:09.729049+0000 mgr.y (mgr.24871) 12 : cephadm [INF] Deploying daemon mon.c on smithi062 2024-02-22T19:15:11.153 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:09.812302+0000 mgr.y (mgr.24871) 13 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:11.153 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:11 smithi062 bash[67442]: cephadm 2024-02-22T19:15:09.721592+0000 mgr.y (mgr.24871) 11 : cephadm [INF] Upgrade: Updating mon.c 2024-02-22T19:15:11.153 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:11 smithi062 bash[67442]: cephadm 2024-02-22T19:15:09.729049+0000 mgr.y (mgr.24871) 12 : cephadm [INF] Deploying daemon mon.c on smithi062 2024-02-22T19:15:11.153 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:11 smithi062 bash[67442]: cluster 2024-02-22T19:15:09.812302+0000 mgr.y (mgr.24871) 13 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:11.445 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:11 smithi062 systemd[1]: Stopping Ceph mon.c for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:15:11.445 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:11 smithi062 bash[67442]: debug 2024-02-22T19:15:11.442+0000 7f6e02500700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:15:11.446 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:11 smithi062 bash[67442]: debug 2024-02-22T19:15:11.442+0000 7f6e02500700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-02-22T19:15:11.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:11 smithi063 bash[35391]: cephadm 2024-02-22T19:15:09.721592+0000 mgr.y (mgr.24871) 11 : cephadm [INF] Upgrade: Updating mon.c 2024-02-22T19:15:11.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:11 smithi063 bash[35391]: cephadm 2024-02-22T19:15:09.729049+0000 mgr.y (mgr.24871) 12 : cephadm [INF] Deploying daemon mon.c on smithi062 2024-02-22T19:15:11.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:11 smithi063 bash[35391]: cluster 2024-02-22T19:15:09.812302+0000 mgr.y (mgr.24871) 13 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:12.179 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:12 smithi062 bash[91098]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon.c 2024-02-22T19:15:12.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:12 smithi062 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.c.service: Succeeded. 2024-02-22T19:15:12.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:12 smithi062 systemd[1]: Stopped Ceph mon.c for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:15:12.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:12 smithi062 systemd[1]: Starting Ceph mon.c for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:15:13.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.237+0000 7efd8e4ea880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-22T19:15:13.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.237+0000 7efd8e4ea880 0 ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable), process ceph-mon, pid 7 2024-02-22T19:15:13.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.237+0000 7efd8e4ea880 0 pidfile_write: ignore empty --pid-file 2024-02-22T19:15:13.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.241+0000 7efd8e4ea880 0 load: jerasure load: lrc load: isa 2024-02-22T19:15:13.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: RocksDB version: 6.8.1 2024-02-22T19:15:13.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-22T19:15:13.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Compile date Feb 20 2024 2024-02-22T19:15:13.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: DB SUMMARY 2024-02-22T19:15:13.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: CURRENT file: CURRENT 2024-02-22T19:15:13.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-22T19:15:13.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 826 Bytes 2024-02-22T19:15:13.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 3, files: 000022.sst 000023.sst 000025.sst 2024-02-22T19:15:13.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000024.log size: 221060 ; 2024-02-22T19:15:13.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.error_if_exists: 0 2024-02-22T19:15:13.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.create_if_missing: 0 2024-02-22T19:15:13.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.paranoid_checks: 1 2024-02-22T19:15:13.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.env: 0x556e878cd080 2024-02-22T19:15:13.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.fs: Posix File System 2024-02-22T19:15:13.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.info_log: 0x556e88f10260 2024-02-22T19:15:13.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-22T19:15:13.737 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.statistics: (nil) 2024-02-22T19:15:13.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.use_fsync: 0 2024-02-22T19:15:13.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_log_file_size: 0 2024-02-22T19:15:13.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-22T19:15:13.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-22T19:15:13.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-22T19:15:13.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-22T19:15:13.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.allow_fallocate: 1 2024-02-22T19:15:13.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-22T19:15:13.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-22T19:15:13.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.use_direct_reads: 0 2024-02-22T19:15:13.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-22T19:15:13.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-22T19:15:13.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.db_log_dir: 2024-02-22T19:15:13.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2024-02-22T19:15:13.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-22T19:15:13.738 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_subcompactions: 1 2024-02-22T19:15:13.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_background_flushes: -1 2024-02-22T19:15:13.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-22T19:15:13.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-22T19:15:13.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-22T19:15:13.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-22T19:15:13.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-22T19:15:13.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-22T19:15:13.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-22T19:15:13.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.write_buffer_manager: 0x556e89c02360 2024-02-22T19:15:13.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-22T19:15:13.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-22T19:15:13.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-22T19:15:13.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-22T19:15:13.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-22T19:15:13.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-22T19:15:13.739 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-22T19:15:13.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-22T19:15:13.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-22T19:15:13.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.unordered_write: 0 2024-02-22T19:15:13.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-22T19:15:13.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-22T19:15:13.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-22T19:15:13.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-22T19:15:13.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.row_cache: None 2024-02-22T19:15:13.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.wal_filter: None 2024-02-22T19:15:13.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-22T19:15:13.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-22T19:15:13.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.preserve_deletes: 0 2024-02-22T19:15:13.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.two_write_queues: 0 2024-02-22T19:15:13.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-22T19:15:13.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.atomic_flush: 0 2024-02-22T19:15:13.740 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-22T19:15:13.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-22T19:15:13.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-22T19:15:13.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.log_readahead_size: 0 2024-02-22T19:15:13.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-22T19:15:13.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_background_jobs: 2 2024-02-22T19:15:13.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_background_compactions: -1 2024-02-22T19:15:13.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-22T19:15:13.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-22T19:15:13.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-22T19:15:13.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-22T19:15:13.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-22T19:15:13.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-22T19:15:13.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-22T19:15:13.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-22T19:15:13.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_open_files: -1 2024-02-22T19:15:13.741 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-22T19:15:13.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-22T19:15:13.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-22T19:15:13.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-22T19:15:13.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Compression algorithms supported: 2024-02-22T19:15:13.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-22T19:15:13.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: kZSTD supported: 0 2024-02-22T19:15:13.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: kXpressCompression supported: 0 2024-02-22T19:15:13.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-22T19:15:13.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: kLZ4Compression supported: 1 2024-02-22T19:15:13.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: kBZip2Compression supported: 0 2024-02-22T19:15:13.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: kZlibCompression supported: 1 2024-02-22T19:15:13.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: kSnappyCompression supported: 1 2024-02-22T19:15:13.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-22T19:15:13.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-02-22T19:15:13.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-22T19:15:13.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-22T19:15:13.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.merge_operator: 2024-02-22T19:15:13.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.compaction_filter: None 2024-02-22T19:15:13.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-22T19:15:13.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-22T19:15:13.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-22T19:15:13.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556e88eb5d10) 2024-02-22T19:15:13.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cache_index_and_filter_blocks: 1 2024-02-22T19:15:13.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-22T19:15:13.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-22T19:15:13.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: pin_top_level_index_and_filter: 1 2024-02-22T19:15:13.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: index_type: 0 2024-02-22T19:15:13.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: data_block_index_type: 0 2024-02-22T19:15:13.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: index_shortening: 1 2024-02-22T19:15:13.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: data_block_hash_table_util_ratio: 0.750000 2024-02-22T19:15:13.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: hash_index_allow_collision: 1 2024-02-22T19:15:13.743 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: checksum: 1 2024-02-22T19:15:13.744 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: no_block_cache: 0 2024-02-22T19:15:13.744 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: block_cache: 0x556e88eeaf10 2024-02-22T19:15:13.744 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: block_cache_name: BinnedLRUCache 2024-02-22T19:15:13.744 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: block_cache_options: 2024-02-22T19:15:13.744 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: capacity : 536870912 2024-02-22T19:15:13.744 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: num_shard_bits : 4 2024-02-22T19:15:13.744 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: strict_capacity_limit : 0 2024-02-22T19:15:13.744 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: high_pri_pool_ratio: 0.000 2024-02-22T19:15:13.744 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: block_cache_compressed: (nil) 2024-02-22T19:15:13.744 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: persistent_cache: (nil) 2024-02-22T19:15:13.744 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: block_size: 4096 2024-02-22T19:15:13.744 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: block_size_deviation: 10 2024-02-22T19:15:13.744 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: block_restart_interval: 16 2024-02-22T19:15:13.744 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: index_block_restart_interval: 1 2024-02-22T19:15:13.744 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: metadata_block_size: 4096 2024-02-22T19:15:13.744 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: partition_filters: 0 2024-02-22T19:15:13.745 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: use_delta_encoding: 1 2024-02-22T19:15:13.745 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-22T19:15:13.745 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: whole_key_filtering: 1 2024-02-22T19:15:13.745 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: verify_compression: 0 2024-02-22T19:15:13.745 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: read_amp_bytes_per_bit: 0 2024-02-22T19:15:13.745 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: format_version: 2 2024-02-22T19:15:13.745 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: enable_index_compression: 1 2024-02-22T19:15:13.745 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: block_align: 0 2024-02-22T19:15:13.745 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.745 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-22T19:15:13.745 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-22T19:15:13.745 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.compression: NoCompression 2024-02-22T19:15:13.745 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-22T19:15:13.745 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-22T19:15:13.745 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-22T19:15:13.745 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.num_levels: 7 2024-02-22T19:15:13.746 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-22T19:15:13.746 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-22T19:15:13.746 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-22T19:15:13.746 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-22T19:15:13.746 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-22T19:15:13.746 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-22T19:15:13.746 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-22T19:15:13.746 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-22T19:15:13.746 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-22T19:15:13.746 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-22T19:15:13.746 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-22T19:15:13.746 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-22T19:15:13.746 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-22T19:15:13.746 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-22T19:15:13.746 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-22T19:15:13.747 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-22T19:15:13.747 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-22T19:15:13.747 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-22T19:15:13.747 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-22T19:15:13.747 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-22T19:15:13.747 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-22T19:15:13.747 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-22T19:15:13.747 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-22T19:15:13.747 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-22T19:15:13.747 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-22T19:15:13.747 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-22T19:15:13.747 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-22T19:15:13.747 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-22T19:15:13.747 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-22T19:15:13.747 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-22T19:15:13.747 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-22T19:15:13.748 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-22T19:15:13.748 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-22T19:15:13.748 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-22T19:15:13.748 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-22T19:15:13.748 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-22T19:15:13.748 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-22T19:15:13.748 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-22T19:15:13.748 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-22T19:15:13.748 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-22T19:15:13.748 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-22T19:15:13.748 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-22T19:15:13.748 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-22T19:15:13.748 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-22T19:15:13.748 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-22T19:15:13.748 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-22T19:15:13.748 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-22T19:15:13.749 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.table_properties_collectors: 2024-02-22T19:15:13.749 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.inplace_update_support: 0 2024-02-22T19:15:13.749 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-22T19:15:13.749 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-22T19:15:13.749 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-22T19:15:13.750 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-22T19:15:13.750 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.bloom_locality: 0 2024-02-22T19:15:13.750 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.max_successive_merges: 0 2024-02-22T19:15:13.750 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-22T19:15:13.750 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-22T19:15:13.750 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-22T19:15:13.750 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-22T19:15:13.750 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.ttl: 2592000 2024-02-22T19:15:13.750 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.242+0000 7efd8e4ea880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-22T19:15:13.750 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.243+0000 7efd8e4ea880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 27, last_sequence is 10842, log_number is 24,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-22T19:15:13.750 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.750 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.243+0000 7efd8e4ea880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 24 2024-02-22T19:15:13.750 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.751 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.243+0000 7efd8e4ea880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708629313244911, "job": 1, "event": "recovery_started", "log_files": [24]} 2024-02-22T19:15:13.751 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.243+0000 7efd8e4ea880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #24 mode 2 2024-02-22T19:15:13.751 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.243+0000 7efd8e4ea880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-22T19:15:13.751 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.244+0000 7efd8e4ea880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708629313246047, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 148155, "table_properties": {"data_size": 147051, "index_size": 224, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 564, "raw_average_key_size": 25, "raw_value_size": 146420, "raw_average_value_size": 6655, "num_data_blocks": 7, "num_entries": 22, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708629313, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-22T19:15:13.751 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.244+0000 7efd8e4ea880 4 rocksdb: [version_set.cc:3826] Creating manifest 28 2024-02-22T19:15:13.751 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.751 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.244+0000 7efd8e4ea880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708629313246445, "job": 1, "event": "recovery_finished"} 2024-02-22T19:15:13.751 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.245+0000 7efd8e4ea880 4 rocksdb: DB pointer 0x556e88fb3800 2024-02-22T19:15:13.751 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.245+0000 7efd752dc700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-22T19:15:13.751 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.245+0000 7efd752dc700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-22T19:15:13.751 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: ** DB Stats ** 2024-02-22T19:15:13.751 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T19:15:13.751 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-22T19:15:13.751 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-22T19:15:13.751 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T19:15:13.751 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-22T19:15:13.752 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-22T19:15:13.752 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T19:15:13.752 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.752 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: ** Compaction Stats [default] ** 2024-02-22T19:15:13.752 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T19:15:13.752 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T19:15:13.752 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: L0 2/0 20.30 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 186.9 0.00 0.00 1 0.001 0 0 2024-02-22T19:15:13.752 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: L6 2/0 66.54 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T19:15:13.752 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Sum 4/0 86.84 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 186.9 0.00 0.00 1 0.001 0 0 2024-02-22T19:15:13.752 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 186.9 0.00 0.00 1 0.001 0 0 2024-02-22T19:15:13.752 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.752 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: ** Compaction Stats [default] ** 2024-02-22T19:15:13.752 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T19:15:13.753 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T19:15:13.753 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 186.9 0.00 0.00 1 0.001 0 0 2024-02-22T19:15:13.753 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T19:15:13.753 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-22T19:15:13.753 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T19:15:13.753 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T19:15:13.753 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T19:15:13.753 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: AddFile(Keys): cumulative 0, interval 0 2024-02-22T19:15:13.753 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Cumulative compaction: 0.00 GB write, 45.04 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T19:15:13.753 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Interval compaction: 0.00 GB write, 45.04 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T19:15:13.753 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T19:15:13.753 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.753 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: ** File Read Latency Histogram By Level [default] ** 2024-02-22T19:15:13.753 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.753 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: ** Compaction Stats [default] ** 2024-02-22T19:15:13.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T19:15:13.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T19:15:13.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: L0 2/0 20.30 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 186.9 0.00 0.00 1 0.001 0 0 2024-02-22T19:15:13.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: L6 2/0 66.54 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T19:15:13.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Sum 4/0 86.84 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 186.9 0.00 0.00 1 0.001 0 0 2024-02-22T19:15:13.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T19:15:13.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: ** Compaction Stats [default] ** 2024-02-22T19:15:13.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T19:15:13.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T19:15:13.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 186.9 0.00 0.00 1 0.001 0 0 2024-02-22T19:15:13.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T19:15:13.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-22T19:15:13.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T19:15:13.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T19:15:13.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T19:15:13.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: AddFile(Keys): cumulative 0, interval 0 2024-02-22T19:15:13.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Cumulative compaction: 0.00 GB write, 44.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T19:15:13.755 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T19:15:13.755 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T19:15:13.755 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.755 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: ** File Read Latency Histogram By Level [default] ** 2024-02-22T19:15:13.755 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.755 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.246+0000 7efd8e4ea880 0 starting mon.c rank 1 at public addrs [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] at bind addrs [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:15:13.755 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.247+0000 7efd8e4ea880 1 mon.c@-1(???) e3 preinit fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:15:13.755 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.247+0000 7efd8e4ea880 0 mon.c@-1(???).mds e1 new map 2024-02-22T19:15:13.755 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.247+0000 7efd8e4ea880 0 mon.c@-1(???).mds e1 print_map 2024-02-22T19:15:13.755 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: e1 2024-02-22T19:15:13.755 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: enable_multiple, ever_enabled_multiple: 0,0 2024-02-22T19:15:13.755 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T19:15:13.755 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: legacy client fscid: -1 2024-02-22T19:15:13.755 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.755 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: No filesystems configured 2024-02-22T19:15:13.755 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: 2024-02-22T19:15:13.756 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.247+0000 7efd8e4ea880 0 mon.c@-1(???).osd e63 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-22T19:15:13.756 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.247+0000 7efd8e4ea880 0 mon.c@-1(???).osd e63 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T19:15:13.756 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.247+0000 7efd8e4ea880 0 mon.c@-1(???).osd e63 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T19:15:13.756 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.247+0000 7efd8e4ea880 0 mon.c@-1(???).osd e63 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T19:15:13.756 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:09.721592+0000 mgr.y (mgr.24871) 11 : cephadm [INF] Upgrade: Updating mon.c 2024-02-22T19:15:13.756 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:09.729049+0000 mgr.y (mgr.24871) 12 : cephadm [INF] Deploying daemon mon.c on smithi062 2024-02-22T19:15:13.756 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:09.812302+0000 mgr.y (mgr.24871) 13 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:13.756 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:15:13.247+0000 7efd8e4ea880 1 mon.c@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-02-22T19:15:13.756 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 bash[91287]: bef7fc1558151ee4988fd6f46571ce1265e64301a8de685bee205a5cc658aed5 2024-02-22T19:15:13.756 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:13 smithi062 systemd[1]: Started Ceph mon.c for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:15:14.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:13.451773+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-02-22T19:15:14.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:13.452585+0000 mon.a (mon.0) 107 : cluster [INF] mon.a calling monitor election 2024-02-22T19:15:14.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:13.466095+0000 mon.a (mon.0) 108 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-22T19:15:14.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:13.471482+0000 mon.a (mon.0) 109 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0],b=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],c=[v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0]} removed_ranks: {} 2024-02-22T19:15:14.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:13.483200+0000 mon.a (mon.0) 110 : cluster [DBG] fsmap 2024-02-22T19:15:14.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:13.483225+0000 mon.a (mon.0) 111 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-22T19:15:14.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:13.483506+0000 mon.a (mon.0) 112 : cluster [DBG] mgrmap e29: y(active, since 23s), standbys: x 2024-02-22T19:15:14.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:13.483633+0000 mon.a (mon.0) 113 : cluster [INF] overall HEALTH_OK 2024-02-22T19:15:14.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:13.486776+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:14.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:13.487608+0000 mon.a (mon.0) 115 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:15:14.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:13.488934+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:15:14.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:13.813192+0000 mgr.y (mgr.24871) 15 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:14.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:13.451773+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-02-22T19:15:14.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:13.452585+0000 mon.a (mon.0) 107 : cluster [INF] mon.a calling monitor election 2024-02-22T19:15:14.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:13.466095+0000 mon.a (mon.0) 108 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-22T19:15:14.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:13.471482+0000 mon.a (mon.0) 109 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0],b=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],c=[v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0]} removed_ranks: {} 2024-02-22T19:15:14.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:13.483200+0000 mon.a (mon.0) 110 : cluster [DBG] fsmap 2024-02-22T19:15:14.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:13.483225+0000 mon.a (mon.0) 111 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-22T19:15:14.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:13.483506+0000 mon.a (mon.0) 112 : cluster [DBG] mgrmap e29: y(active, since 23s), standbys: x 2024-02-22T19:15:14.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:13.483633+0000 mon.a (mon.0) 113 : cluster [INF] overall HEALTH_OK 2024-02-22T19:15:14.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:13.486776+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:14.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:13.487608+0000 mon.a (mon.0) 115 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:15:14.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:13.488934+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:15:14.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:13.813192+0000 mgr.y (mgr.24871) 15 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:14.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:14 smithi063 bash[35391]: cluster 2024-02-22T19:15:13.451773+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-02-22T19:15:14.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:14 smithi063 bash[35391]: cluster 2024-02-22T19:15:13.452585+0000 mon.a (mon.0) 107 : cluster [INF] mon.a calling monitor election 2024-02-22T19:15:14.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:14 smithi063 bash[35391]: cluster 2024-02-22T19:15:13.466095+0000 mon.a (mon.0) 108 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-22T19:15:14.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:14 smithi063 bash[35391]: cluster 2024-02-22T19:15:13.471482+0000 mon.a (mon.0) 109 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0],b=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],c=[v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0]} removed_ranks: {} 2024-02-22T19:15:14.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:14 smithi063 bash[35391]: cluster 2024-02-22T19:15:13.483200+0000 mon.a (mon.0) 110 : cluster [DBG] fsmap 2024-02-22T19:15:14.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:14 smithi063 bash[35391]: cluster 2024-02-22T19:15:13.483225+0000 mon.a (mon.0) 111 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-22T19:15:14.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:14 smithi063 bash[35391]: cluster 2024-02-22T19:15:13.483506+0000 mon.a (mon.0) 112 : cluster [DBG] mgrmap e29: y(active, since 23s), standbys: x 2024-02-22T19:15:14.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:14 smithi063 bash[35391]: cluster 2024-02-22T19:15:13.483633+0000 mon.a (mon.0) 113 : cluster [INF] overall HEALTH_OK 2024-02-22T19:15:14.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:14 smithi063 bash[35391]: audit 2024-02-22T19:15:13.486776+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:14.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:14 smithi063 bash[35391]: audit 2024-02-22T19:15:13.487608+0000 mon.a (mon.0) 115 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:15:14.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:14 smithi063 bash[35391]: audit 2024-02-22T19:15:13.488934+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:15:14.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:14 smithi063 bash[35391]: cluster 2024-02-22T19:15:13.813192+0000 mgr.y (mgr.24871) 15 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:16.868 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:16 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:15.813581+0000 mgr.y (mgr.24871) 16 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:17.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:16 smithi063 bash[35391]: cluster 2024-02-22T19:15:15.813581+0000 mgr.y (mgr.24871) 16 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:17.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:16 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:15.813581+0000 mgr.y (mgr.24871) 16 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:18.704 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:15:18 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:15:18.253+0000 7f84665ff700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-02-22T19:15:18.826 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:18 smithi063 bash[35391]: audit 2024-02-22T19:15:17.705886+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:18.826 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:18 smithi063 bash[35391]: audit 2024-02-22T19:15:17.713114+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:18.826 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:18 smithi063 bash[35391]: audit 2024-02-22T19:15:17.717878+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:15:18.826 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:18 smithi063 bash[35391]: audit 2024-02-22T19:15:17.719797+0000 mon.a (mon.0) 120 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:15:18.826 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:18 smithi063 bash[35391]: audit 2024-02-22T19:15:17.720773+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-22T19:15:18.826 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:18 smithi063 bash[35391]: audit 2024-02-22T19:15:17.721366+0000 mon.a (mon.0) 122 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-02-22T19:15:18.826 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:18 smithi063 bash[35391]: cephadm 2024-02-22T19:15:17.721804+0000 mgr.y (mgr.24871) 17 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2024-02-22T19:15:18.826 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:18 smithi063 bash[35391]: cluster 2024-02-22T19:15:17.814177+0000 mgr.y (mgr.24871) 18 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:18.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:18 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:17.705886+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:18.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:18 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:17.713114+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:18.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:18 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:17.717878+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:15:18.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:18 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:17.719797+0000 mon.a (mon.0) 120 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:15:18.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:18 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:17.720773+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-22T19:15:18.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:18 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:17.721366+0000 mon.a (mon.0) 122 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-02-22T19:15:18.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:18 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:17.721804+0000 mgr.y (mgr.24871) 17 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2024-02-22T19:15:18.985 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:18 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:17.814177+0000 mgr.y (mgr.24871) 18 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:18.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:18 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:17.705886+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:18.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:18 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:17.713114+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:18.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:18 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:17.717878+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:15:18.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:18 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:17.719797+0000 mon.a (mon.0) 120 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:15:18.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:18 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:17.720773+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-22T19:15:18.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:18 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:17.721366+0000 mon.a (mon.0) 122 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-02-22T19:15:18.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:18 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:17.721804+0000 mgr.y (mgr.24871) 17 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2024-02-22T19:15:18.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:18 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:17.814177+0000 mgr.y (mgr.24871) 18 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:20.455 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:20 smithi063 bash[35391]: cephadm 2024-02-22T19:15:19.141239+0000 mgr.y (mgr.24871) 19 : cephadm [INF] Upgrade: Updating mon.b 2024-02-22T19:15:20.455 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:20 smithi063 bash[35391]: audit 2024-02-22T19:15:19.147836+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:20.455 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:20 smithi063 bash[35391]: audit 2024-02-22T19:15:19.148760+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:15:20.455 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:20 smithi063 bash[35391]: audit 2024-02-22T19:15:19.149553+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:15:20.455 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:20 smithi063 bash[35391]: audit 2024-02-22T19:15:19.150296+0000 mon.a (mon.0) 126 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:20.455 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:20 smithi063 bash[35391]: cephadm 2024-02-22T19:15:19.151040+0000 mgr.y (mgr.24871) 20 : cephadm [INF] Deploying daemon mon.b on smithi063 2024-02-22T19:15:20.455 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:20 smithi063 bash[35391]: audit 2024-02-22T19:15:19.151487+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-22T19:15:20.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:20 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:19.141239+0000 mgr.y (mgr.24871) 19 : cephadm [INF] Upgrade: Updating mon.b 2024-02-22T19:15:20.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:20 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:19.147836+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:20.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:20 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:19.148760+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:15:20.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:20 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:19.149553+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:15:20.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:20 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:19.150296+0000 mon.a (mon.0) 126 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:20.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:20 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:19.151040+0000 mgr.y (mgr.24871) 20 : cephadm [INF] Deploying daemon mon.b on smithi063 2024-02-22T19:15:20.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:20 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:19.151487+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-22T19:15:20.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:20 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:19.141239+0000 mgr.y (mgr.24871) 19 : cephadm [INF] Upgrade: Updating mon.b 2024-02-22T19:15:20.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:20 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:19.147836+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:20.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:20 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:19.148760+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:15:20.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:20 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:19.149553+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:15:20.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:20 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:19.150296+0000 mon.a (mon.0) 126 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:20.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:20 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:19.151040+0000 mgr.y (mgr.24871) 20 : cephadm [INF] Deploying daemon mon.b on smithi063 2024-02-22T19:15:20.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:20 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:19.151487+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-22T19:15:20.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:20 smithi063 systemd[1]: Stopping Ceph mon.b for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:15:21.016 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:20 smithi063 bash[35391]: debug 2024-02-22T19:15:20.738+0000 7f091f053700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:15:21.016 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:20 smithi063 bash[35391]: debug 2024-02-22T19:15:20.738+0000 7f091f053700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-02-22T19:15:21.564 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:21 smithi063 bash[54030]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon.b 2024-02-22T19:15:22.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:21 smithi063 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.b.service: Succeeded. 2024-02-22T19:15:22.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:21 smithi063 systemd[1]: Stopped Ceph mon.b for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:15:22.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 systemd[1]: Starting Ceph mon.b for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:15:22.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.590+0000 7f4d149b0880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-22T19:15:22.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.590+0000 7f4d149b0880 0 ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable), process ceph-mon, pid 7 2024-02-22T19:15:22.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.590+0000 7f4d149b0880 0 pidfile_write: ignore empty --pid-file 2024-02-22T19:15:22.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.594+0000 7f4d149b0880 0 load: jerasure load: lrc load: isa 2024-02-22T19:15:22.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: RocksDB version: 6.8.1 2024-02-22T19:15:22.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-22T19:15:22.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Compile date Feb 20 2024 2024-02-22T19:15:22.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: DB SUMMARY 2024-02-22T19:15:22.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: CURRENT file: CURRENT 2024-02-22T19:15:22.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-22T19:15:22.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 826 Bytes 2024-02-22T19:15:22.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 3, files: 000022.sst 000023.sst 000025.sst 2024-02-22T19:15:22.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000024.log size: 907660 ; 2024-02-22T19:15:22.965 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.error_if_exists: 0 2024-02-22T19:15:22.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.create_if_missing: 0 2024-02-22T19:15:22.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.paranoid_checks: 1 2024-02-22T19:15:22.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.env: 0x55b2ec372080 2024-02-22T19:15:22.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.fs: Posix File System 2024-02-22T19:15:22.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.info_log: 0x55b2ed9c8260 2024-02-22T19:15:22.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-22T19:15:22.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.statistics: (nil) 2024-02-22T19:15:22.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.use_fsync: 0 2024-02-22T19:15:22.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_log_file_size: 0 2024-02-22T19:15:22.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-22T19:15:22.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-22T19:15:22.966 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-22T19:15:22.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-22T19:15:22.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.allow_fallocate: 1 2024-02-22T19:15:22.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-22T19:15:22.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-22T19:15:22.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.use_direct_reads: 0 2024-02-22T19:15:22.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-22T19:15:22.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-22T19:15:22.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.db_log_dir: 2024-02-22T19:15:22.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2024-02-22T19:15:22.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-22T19:15:22.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_subcompactions: 1 2024-02-22T19:15:22.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_background_flushes: -1 2024-02-22T19:15:22.967 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-22T19:15:22.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-22T19:15:22.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-22T19:15:22.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-22T19:15:22.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-22T19:15:22.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-22T19:15:22.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-22T19:15:22.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.write_buffer_manager: 0x55b2ee6ba360 2024-02-22T19:15:22.969 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-22T19:15:22.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-22T19:15:22.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-22T19:15:22.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-22T19:15:22.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-22T19:15:22.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-22T19:15:22.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-22T19:15:22.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-22T19:15:22.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-22T19:15:22.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.unordered_write: 0 2024-02-22T19:15:22.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-22T19:15:22.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-22T19:15:22.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-22T19:15:22.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-22T19:15:22.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.row_cache: None 2024-02-22T19:15:22.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.wal_filter: None 2024-02-22T19:15:22.970 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-22T19:15:22.971 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-22T19:15:22.971 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.preserve_deletes: 0 2024-02-22T19:15:22.971 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.two_write_queues: 0 2024-02-22T19:15:22.971 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-22T19:15:22.971 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.atomic_flush: 0 2024-02-22T19:15:22.971 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-22T19:15:22.971 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-22T19:15:22.971 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-22T19:15:22.971 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.log_readahead_size: 0 2024-02-22T19:15:22.971 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-22T19:15:22.971 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_background_jobs: 2 2024-02-22T19:15:22.971 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_background_compactions: -1 2024-02-22T19:15:22.971 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-22T19:15:22.971 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-22T19:15:22.972 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-22T19:15:22.972 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-22T19:15:22.972 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-22T19:15:22.972 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-22T19:15:22.972 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-22T19:15:22.972 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-22T19:15:22.972 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_open_files: -1 2024-02-22T19:15:22.972 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-22T19:15:22.972 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-22T19:15:22.972 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-22T19:15:22.972 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-22T19:15:22.972 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Compression algorithms supported: 2024-02-22T19:15:22.972 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-22T19:15:22.972 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: kZSTD supported: 0 2024-02-22T19:15:22.972 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: kXpressCompression supported: 0 2024-02-22T19:15:22.973 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-22T19:15:22.973 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: kLZ4Compression supported: 1 2024-02-22T19:15:22.973 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: kBZip2Compression supported: 0 2024-02-22T19:15:22.973 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: kZlibCompression supported: 1 2024-02-22T19:15:22.973 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: kSnappyCompression supported: 1 2024-02-22T19:15:22.973 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-22T19:15:22.973 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-02-22T19:15:22.973 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.973 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-22T19:15:22.973 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.973 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-22T19:15:22.973 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.merge_operator: 2024-02-22T19:15:22.973 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.compaction_filter: None 2024-02-22T19:15:22.973 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-22T19:15:22.974 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-22T19:15:22.974 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-22T19:15:22.974 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b2ed96dd10) 2024-02-22T19:15:22.974 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cache_index_and_filter_blocks: 1 2024-02-22T19:15:22.974 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-22T19:15:22.974 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-22T19:15:22.974 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: pin_top_level_index_and_filter: 1 2024-02-22T19:15:22.974 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: index_type: 0 2024-02-22T19:15:22.974 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: data_block_index_type: 0 2024-02-22T19:15:22.974 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: index_shortening: 1 2024-02-22T19:15:22.974 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: data_block_hash_table_util_ratio: 0.750000 2024-02-22T19:15:22.974 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: hash_index_allow_collision: 1 2024-02-22T19:15:22.974 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: checksum: 1 2024-02-22T19:15:22.974 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: no_block_cache: 0 2024-02-22T19:15:22.974 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: block_cache: 0x55b2ed9a2f10 2024-02-22T19:15:22.975 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: block_cache_name: BinnedLRUCache 2024-02-22T19:15:22.975 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: block_cache_options: 2024-02-22T19:15:22.975 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: capacity : 536870912 2024-02-22T19:15:22.975 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: num_shard_bits : 4 2024-02-22T19:15:22.975 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: strict_capacity_limit : 0 2024-02-22T19:15:22.975 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: high_pri_pool_ratio: 0.000 2024-02-22T19:15:22.975 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: block_cache_compressed: (nil) 2024-02-22T19:15:22.975 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: persistent_cache: (nil) 2024-02-22T19:15:22.975 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: block_size: 4096 2024-02-22T19:15:22.975 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: block_size_deviation: 10 2024-02-22T19:15:22.975 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: block_restart_interval: 16 2024-02-22T19:15:22.975 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: index_block_restart_interval: 1 2024-02-22T19:15:22.975 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: metadata_block_size: 4096 2024-02-22T19:15:22.975 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: partition_filters: 0 2024-02-22T19:15:22.975 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: use_delta_encoding: 1 2024-02-22T19:15:22.975 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-22T19:15:22.976 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: whole_key_filtering: 1 2024-02-22T19:15:22.976 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: verify_compression: 0 2024-02-22T19:15:22.976 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: read_amp_bytes_per_bit: 0 2024-02-22T19:15:22.976 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: format_version: 2 2024-02-22T19:15:22.976 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: enable_index_compression: 1 2024-02-22T19:15:22.976 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: block_align: 0 2024-02-22T19:15:22.976 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.976 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-22T19:15:22.976 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-22T19:15:22.976 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.compression: NoCompression 2024-02-22T19:15:22.976 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-22T19:15:22.976 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-22T19:15:22.976 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-22T19:15:22.976 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.num_levels: 7 2024-02-22T19:15:22.976 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-22T19:15:22.977 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-22T19:15:22.977 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-22T19:15:22.977 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-22T19:15:22.977 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-22T19:15:22.977 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-22T19:15:22.977 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-22T19:15:22.977 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-22T19:15:22.977 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-22T19:15:22.977 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-22T19:15:22.977 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-22T19:15:22.977 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-22T19:15:22.977 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-22T19:15:22.977 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-22T19:15:22.977 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-22T19:15:22.977 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-22T19:15:22.978 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-22T19:15:22.978 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-22T19:15:22.978 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-22T19:15:22.978 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-22T19:15:22.978 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-22T19:15:22.978 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-22T19:15:22.978 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-22T19:15:22.978 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-22T19:15:22.978 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-22T19:15:22.978 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-22T19:15:22.978 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-22T19:15:22.978 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-22T19:15:22.978 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-22T19:15:22.978 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-22T19:15:22.978 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-22T19:15:22.979 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-22T19:15:22.979 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-22T19:15:22.979 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-22T19:15:22.979 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-22T19:15:22.979 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-22T19:15:22.979 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-22T19:15:22.979 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-22T19:15:22.979 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-22T19:15:22.979 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-22T19:15:22.979 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-22T19:15:22.979 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-22T19:15:22.979 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-22T19:15:22.979 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-22T19:15:22.979 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-22T19:15:22.980 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-22T19:15:22.980 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-22T19:15:22.980 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.table_properties_collectors: 2024-02-22T19:15:22.980 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.inplace_update_support: 0 2024-02-22T19:15:22.980 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-22T19:15:22.980 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-22T19:15:22.980 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-22T19:15:22.980 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-22T19:15:22.980 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.bloom_locality: 0 2024-02-22T19:15:22.980 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.max_successive_merges: 0 2024-02-22T19:15:22.980 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-22T19:15:22.980 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-22T19:15:22.980 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-22T19:15:22.980 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-22T19:15:22.980 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.ttl: 2592000 2024-02-22T19:15:22.980 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.595+0000 7f4d149b0880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-22T19:15:22.981 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.596+0000 7f4d149b0880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 27, last_sequence is 10725, log_number is 24,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-22T19:15:22.981 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.981 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.596+0000 7f4d149b0880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 24 2024-02-22T19:15:22.981 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.981 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.596+0000 7f4d149b0880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708629322597477, "job": 1, "event": "recovery_started", "log_files": [24]} 2024-02-22T19:15:22.981 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.596+0000 7f4d149b0880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #24 mode 2 2024-02-22T19:15:22.981 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.597+0000 7f4d149b0880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-22T19:15:22.981 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.599+0000 7f4d149b0880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708629322599988, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 588227, "table_properties": {"data_size": 586163, "index_size": 1054, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 197, "raw_key_size": 1585, "raw_average_key_size": 23, "raw_value_size": 584168, "raw_average_value_size": 8718, "num_data_blocks": 34, "num_entries": 67, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708629322, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-22T19:15:22.981 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.599+0000 7f4d149b0880 4 rocksdb: [version_set.cc:3826] Creating manifest 28 2024-02-22T19:15:22.981 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.981 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.599+0000 7f4d149b0880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708629322600857, "job": 1, "event": "recovery_finished"} 2024-02-22T19:15:22.981 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.600+0000 7f4d149b0880 4 rocksdb: DB pointer 0x55b2eda6b800 2024-02-22T19:15:22.981 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.600+0000 7f4cfb7a2700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-22T19:15:22.981 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.600+0000 7f4cfb7a2700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-22T19:15:22.981 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: ** DB Stats ** 2024-02-22T19:15:22.981 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T19:15:22.982 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-22T19:15:22.982 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-22T19:15:22.982 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T19:15:22.982 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-22T19:15:22.982 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-22T19:15:22.982 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-22T19:15:22.982 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.982 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: ** Compaction Stats [default] ** 2024-02-22T19:15:22.982 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T19:15:22.982 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T19:15:22.982 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: L0 2/0 20.72 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 361.7 0.00 0.00 1 0.002 0 0 2024-02-22T19:15:22.982 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: L6 2/0 66.54 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T19:15:22.982 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Sum 4/0 87.26 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 361.7 0.00 0.00 1 0.002 0 0 2024-02-22T19:15:22.982 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 361.7 0.00 0.00 1 0.002 0 0 2024-02-22T19:15:22.982 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.983 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: ** Compaction Stats [default] ** 2024-02-22T19:15:22.983 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T19:15:22.983 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T19:15:22.983 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 361.7 0.00 0.00 1 0.002 0 0 2024-02-22T19:15:22.983 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T19:15:22.983 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Flush(GB): cumulative 0.001, interval 0.001 2024-02-22T19:15:22.983 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T19:15:22.983 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T19:15:22.983 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T19:15:22.983 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: AddFile(Keys): cumulative 0, interval 0 2024-02-22T19:15:22.983 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Cumulative compaction: 0.00 GB write, 108.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T19:15:22.983 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Interval compaction: 0.00 GB write, 108.15 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T19:15:22.983 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T19:15:22.983 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.983 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: ** File Read Latency Histogram By Level [default] ** 2024-02-22T19:15:22.984 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.984 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: ** Compaction Stats [default] ** 2024-02-22T19:15:22.984 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T19:15:22.984 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T19:15:22.984 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: L0 2/0 20.72 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 361.7 0.00 0.00 1 0.002 0 0 2024-02-22T19:15:22.984 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: L6 2/0 66.54 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T19:15:22.984 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Sum 4/0 87.26 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 361.7 0.00 0.00 1 0.002 0 0 2024-02-22T19:15:22.984 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-22T19:15:22.984 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.984 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: ** Compaction Stats [default] ** 2024-02-22T19:15:22.984 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-22T19:15:22.984 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-22T19:15:22.984 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 361.7 0.00 0.00 1 0.002 0 0 2024-02-22T19:15:22.984 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-22T19:15:22.985 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Flush(GB): cumulative 0.001, interval 0.000 2024-02-22T19:15:22.985 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-22T19:15:22.985 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: AddFile(Total Files): cumulative 0, interval 0 2024-02-22T19:15:22.985 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-22T19:15:22.985 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: AddFile(Keys): cumulative 0, interval 0 2024-02-22T19:15:22.985 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Cumulative compaction: 0.00 GB write, 107.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T19:15:22.985 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-22T19:15:22.985 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-22T19:15:22.985 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.985 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: ** File Read Latency Histogram By Level [default] ** 2024-02-22T19:15:22.985 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.985 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.601+0000 7f4d149b0880 0 starting mon.b rank 2 at public addrs [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] at bind addrs [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:15:22.985 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.602+0000 7f4d149b0880 1 mon.b@-1(???) e3 preinit fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 2024-02-22T19:15:22.985 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.602+0000 7f4d149b0880 0 mon.b@-1(???).mds e1 new map 2024-02-22T19:15:22.985 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.602+0000 7f4d149b0880 0 mon.b@-1(???).mds e1 print_map 2024-02-22T19:15:22.985 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: e1 2024-02-22T19:15:22.986 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: enable_multiple, ever_enabled_multiple: 0,0 2024-02-22T19:15:22.986 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-22T19:15:22.986 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: legacy client fscid: -1 2024-02-22T19:15:22.986 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.986 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: No filesystems configured 2024-02-22T19:15:22.986 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: 2024-02-22T19:15:22.986 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.602+0000 7f4d149b0880 0 mon.b@-1(???).osd e63 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-22T19:15:22.986 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.602+0000 7f4d149b0880 0 mon.b@-1(???).osd e63 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T19:15:22.986 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.602+0000 7f4d149b0880 0 mon.b@-1(???).osd e63 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T19:15:22.986 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.602+0000 7f4d149b0880 0 mon.b@-1(???).osd e63 crush map has features 288514051259236352, adjusting msgr requires 2024-02-22T19:15:22.986 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:19.141239+0000 mgr.y (mgr.24871) 19 : cephadm [INF] Upgrade: Updating mon.b 2024-02-22T19:15:22.986 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:19.147836+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:22.986 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:19.148760+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:15:22.986 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:19.149553+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:15:22.986 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:19.150296+0000 mon.a (mon.0) 126 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:22.986 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:19.151040+0000 mgr.y (mgr.24871) 20 : cephadm [INF] Deploying daemon mon.b on smithi063 2024-02-22T19:15:22.987 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:19.151487+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-22T19:15:22.987 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:15:22.602+0000 7f4d149b0880 1 mon.b@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-02-22T19:15:22.987 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 bash[54219]: feaf82947040fd86755f2e87ae2ebe4a756d402acfaf9a5117fcd000dfa34bcf 2024-02-22T19:15:22.987 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:22 smithi063 systemd[1]: Started Ceph mon.b for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:15:23.734 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:15:23 smithi062 bash[86519]: ts=2024-02-22T19:15:23.248Z caller=notify.go:745 level=warn component=dispatcher receiver=web.hook integration=webhook[0] aggrGroup="{}:{alertname=\"CephMgrPrometheusModuleInactive\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 127.0.0.1:5001: connect: connection refused" 2024-02-22T19:15:24.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:24 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:19.814581+0000 mgr.y (mgr.24871) 21 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:24.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:24 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:19.814581+0000 mgr.y (mgr.24871) 21 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:24.484 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:24 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:19.814581+0000 mgr.y (mgr.24871) 21 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:25.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:25 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:23.815946+0000 mgr.y (mgr.24871) 23 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:25.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:25 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:24.195844+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-02-22T19:15:25.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:25 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:24.195906+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-02-22T19:15:25.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:25 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:24.195911+0000 mon.a (mon.0) 135 : cluster [INF] mon.a calling monitor election 2024-02-22T19:15:25.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:25 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:24.197391+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T19:15:25.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:25 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:24.197536+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T19:15:25.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:25 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:24.197705+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T19:15:25.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:25 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:24.210650+0000 mon.a (mon.0) 139 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-22T19:15:25.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:25 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:24.216375+0000 mon.a (mon.0) 140 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0],b=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],c=[v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0]} removed_ranks: {} 2024-02-22T19:15:25.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:25 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:24.216857+0000 mon.a (mon.0) 141 : cluster [DBG] fsmap 2024-02-22T19:15:25.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:25 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:24.216890+0000 mon.a (mon.0) 142 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-22T19:15:25.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:25 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:24.217325+0000 mon.a (mon.0) 143 : cluster [DBG] mgrmap e29: y(active, since 34s), standbys: x 2024-02-22T19:15:25.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:25 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:24.217490+0000 mon.a (mon.0) 144 : cluster [INF] overall HEALTH_OK 2024-02-22T19:15:25.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:25 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:24.232380+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:25.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:25 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:24.233502+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:15:25.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:25 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:24.235351+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:15:25.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:23.815946+0000 mgr.y (mgr.24871) 23 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:25.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:24.195844+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-02-22T19:15:25.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:24.195906+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-02-22T19:15:25.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:24.195911+0000 mon.a (mon.0) 135 : cluster [INF] mon.a calling monitor election 2024-02-22T19:15:25.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:24.197391+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T19:15:25.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:24.197536+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T19:15:25.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:24.197705+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T19:15:25.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:24.210650+0000 mon.a (mon.0) 139 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-22T19:15:25.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:24.216375+0000 mon.a (mon.0) 140 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0],b=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],c=[v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0]} removed_ranks: {} 2024-02-22T19:15:25.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:24.216857+0000 mon.a (mon.0) 141 : cluster [DBG] fsmap 2024-02-22T19:15:25.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:24.216890+0000 mon.a (mon.0) 142 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-22T19:15:25.486 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:24.217325+0000 mon.a (mon.0) 143 : cluster [DBG] mgrmap e29: y(active, since 34s), standbys: x 2024-02-22T19:15:25.486 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:24.217490+0000 mon.a (mon.0) 144 : cluster [INF] overall HEALTH_OK 2024-02-22T19:15:25.486 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:24.232380+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:25.486 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:24.233502+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:15:25.486 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:24.235351+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:15:25.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:23.815946+0000 mgr.y (mgr.24871) 23 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:25.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:24.195844+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-02-22T19:15:25.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:24.195906+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-02-22T19:15:25.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:24.195911+0000 mon.a (mon.0) 135 : cluster [INF] mon.a calling monitor election 2024-02-22T19:15:25.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:24.197391+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-22T19:15:25.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:24.197536+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-22T19:15:25.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:24.197705+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-22T19:15:25.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:24.210650+0000 mon.a (mon.0) 139 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-22T19:15:25.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:24.216375+0000 mon.a (mon.0) 140 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0],b=[v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0],c=[v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0]} removed_ranks: {} 2024-02-22T19:15:25.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:24.216857+0000 mon.a (mon.0) 141 : cluster [DBG] fsmap 2024-02-22T19:15:25.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:24.216890+0000 mon.a (mon.0) 142 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-22T19:15:25.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:24.217325+0000 mon.a (mon.0) 143 : cluster [DBG] mgrmap e29: y(active, since 34s), standbys: x 2024-02-22T19:15:25.487 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:24.217490+0000 mon.a (mon.0) 144 : cluster [INF] overall HEALTH_OK 2024-02-22T19:15:25.488 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:24.232380+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:25.488 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:24.233502+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:15:25.488 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:25 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:24.235351+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:15:26.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:26 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:25.816480+0000 mgr.y (mgr.24871) 24 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:26.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:26 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:25.816480+0000 mgr.y (mgr.24871) 24 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:26.484 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:26 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:25.816480+0000 mgr.y (mgr.24871) 24 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:27.984 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:15:27 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:15:27.607+0000 7f84665ff700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-02-22T19:15:28.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:28 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:27.817135+0000 mgr.y (mgr.24871) 25 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:28.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:28 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:27.817135+0000 mgr.y (mgr.24871) 25 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:28.984 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:28 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:27.817135+0000 mgr.y (mgr.24871) 25 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:30.603 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:30 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:29.319710+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:30.604 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:30 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:29.327251+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:30.604 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:30 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:29.330624+0000 mgr.y (mgr.24871) 26 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-02-22T19:15:30.604 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:30 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:29.330940+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:15:30.604 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:30 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:29.331759+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:15:30.604 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:30 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:29.332519+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:30.604 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:30 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:29.333198+0000 mgr.y (mgr.24871) 27 : cephadm [INF] Reconfiguring daemon mon.a on smithi062 2024-02-22T19:15:30.604 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:30 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:29.333653+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-22T19:15:30.604 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:30 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:29.817688+0000 mgr.y (mgr.24871) 28 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:30.605 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:30 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:29.319710+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:30.605 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:30 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:29.327251+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:30.605 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:30 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:29.330624+0000 mgr.y (mgr.24871) 26 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-02-22T19:15:30.605 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:30 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:29.330940+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:15:30.605 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:30 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:29.331759+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:15:30.605 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:30 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:29.332519+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:30.605 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:30 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:29.333198+0000 mgr.y (mgr.24871) 27 : cephadm [INF] Reconfiguring daemon mon.a on smithi062 2024-02-22T19:15:30.605 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:30 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:29.333653+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-22T19:15:30.605 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:30 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:29.817688+0000 mgr.y (mgr.24871) 28 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:30.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:30 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:29.319710+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:30.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:30 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:29.327251+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:30.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:30 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:29.330624+0000 mgr.y (mgr.24871) 26 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-02-22T19:15:30.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:30 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:29.330940+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:15:30.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:30 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:29.331759+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:15:30.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:30 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:29.332519+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:30.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:30 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:29.333198+0000 mgr.y (mgr.24871) 27 : cephadm [INF] Reconfiguring daemon mon.a on smithi062 2024-02-22T19:15:30.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:30 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:29.333653+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-22T19:15:30.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:30 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:29.817688+0000 mgr.y (mgr.24871) 28 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:31.955 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:31 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:30.648817+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:31.955 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:31 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:30.649530+0000 mgr.y (mgr.24871) 29 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2024-02-22T19:15:31.955 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:31 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:30.649778+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:15:31.955 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:31 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:30.650390+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T19:15:31.955 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:31 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:30.650996+0000 mon.a (mon.0) 157 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:31.955 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:31 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:30.651477+0000 mgr.y (mgr.24871) 30 : cephadm [INF] Reconfiguring daemon mgr.y on smithi062 2024-02-22T19:15:31.955 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:31 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:30.651795+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-22T19:15:31.955 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:31 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:30.648817+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:31.955 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:31 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:30.649530+0000 mgr.y (mgr.24871) 29 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2024-02-22T19:15:31.956 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:31 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:30.649778+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:15:31.956 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:31 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:30.650390+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T19:15:31.956 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:31 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:30.650996+0000 mon.a (mon.0) 157 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:31.956 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:31 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:30.651477+0000 mgr.y (mgr.24871) 30 : cephadm [INF] Reconfiguring daemon mgr.y on smithi062 2024-02-22T19:15:31.956 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:31 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:30.651795+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-22T19:15:31.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:31 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:30.648817+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:31.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:31 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:30.649530+0000 mgr.y (mgr.24871) 29 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2024-02-22T19:15:31.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:31 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:30.649778+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:15:31.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:31 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:30.650390+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T19:15:31.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:31 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:30.650996+0000 mon.a (mon.0) 157 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:31.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:31 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:30.651477+0000 mgr.y (mgr.24871) 30 : cephadm [INF] Reconfiguring daemon mgr.y on smithi062 2024-02-22T19:15:31.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:31 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:30.651795+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-22T19:15:33.020 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:33 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:31.818565+0000 mgr.y (mgr.24871) 31 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:33.020 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:33 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:32.019605+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:33.020 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:33 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:32.020374+0000 mgr.y (mgr.24871) 32 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-22T19:15:33.020 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:33 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:32.020629+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:15:33.302 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:33 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:32.021287+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:15:33.302 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:33 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:32.021924+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:33.302 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:33 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:32.022435+0000 mgr.y (mgr.24871) 33 : cephadm [INF] Reconfiguring daemon mon.c on smithi062 2024-02-22T19:15:33.302 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:33 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:32.022809+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-22T19:15:33.303 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:33 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:31.818565+0000 mgr.y (mgr.24871) 31 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:33.303 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:33 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:32.019605+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:33.303 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:33 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:32.020374+0000 mgr.y (mgr.24871) 32 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-22T19:15:33.303 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:33 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:32.020629+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:15:33.303 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:33 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:32.021287+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:15:33.303 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:33 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:32.021924+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:33.303 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:33 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:32.022435+0000 mgr.y (mgr.24871) 33 : cephadm [INF] Reconfiguring daemon mon.c on smithi062 2024-02-22T19:15:33.303 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:33 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:32.022809+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-22T19:15:33.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:33 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:31.818565+0000 mgr.y (mgr.24871) 31 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:33.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:33 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:32.019605+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:33.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:33 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:32.020374+0000 mgr.y (mgr.24871) 32 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-22T19:15:33.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:33 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:32.020629+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:15:33.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:33 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:32.021287+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:15:33.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:33 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:32.021924+0000 mon.a (mon.0) 162 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:33.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:33 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:32.022435+0000 mgr.y (mgr.24871) 33 : cephadm [INF] Reconfiguring daemon mon.c on smithi062 2024-02-22T19:15:33.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:33 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:32.022809+0000 mon.a (mon.0) 163 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-22T19:15:34.601 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:34 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:33.347245+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:34.601 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:34 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:33.347998+0000 mgr.y (mgr.24871) 34 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2024-02-22T19:15:34.601 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:34 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:33.348271+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-22T19:15:34.601 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:34 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:33.348862+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:34.601 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:34 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:33.349932+0000 mgr.y (mgr.24871) 35 : cephadm [INF] Reconfiguring daemon osd.0 on smithi062 2024-02-22T19:15:34.601 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:34 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:33.350319+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-02-22T19:15:34.601 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:34 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:33.818847+0000 mgr.y (mgr.24871) 36 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:34.601 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:34 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:33.347245+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:34.601 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:34 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:33.347998+0000 mgr.y (mgr.24871) 34 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2024-02-22T19:15:34.601 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:34 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:33.348271+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-22T19:15:34.602 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:34 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:33.348862+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:34.602 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:34 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:33.349932+0000 mgr.y (mgr.24871) 35 : cephadm [INF] Reconfiguring daemon osd.0 on smithi062 2024-02-22T19:15:34.602 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:34 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:33.350319+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-02-22T19:15:34.602 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:34 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:33.818847+0000 mgr.y (mgr.24871) 36 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:34.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:34 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:33.347245+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:34.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:34 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:33.347998+0000 mgr.y (mgr.24871) 34 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2024-02-22T19:15:34.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:34 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:33.348271+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-22T19:15:34.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:34 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:33.348862+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:34.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:34 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:33.349932+0000 mgr.y (mgr.24871) 35 : cephadm [INF] Reconfiguring daemon osd.0 on smithi062 2024-02-22T19:15:34.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:34 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:33.350319+0000 mon.a (mon.0) 167 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-02-22T19:15:34.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:34 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:33.818847+0000 mgr.y (mgr.24871) 36 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:35.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:35 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:34.660900+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:35.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:35 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:34.661615+0000 mgr.y (mgr.24871) 37 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2024-02-22T19:15:35.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:35 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:34.661851+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-22T19:15:35.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:35 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:34.662405+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:35.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:35 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:34.663399+0000 mgr.y (mgr.24871) 38 : cephadm [INF] Reconfiguring daemon osd.1 on smithi062 2024-02-22T19:15:35.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:35 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:34.663758+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2024-02-22T19:15:35.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:35 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:34.660900+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:35.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:35 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:34.661615+0000 mgr.y (mgr.24871) 37 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2024-02-22T19:15:35.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:35 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:34.661851+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-22T19:15:35.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:35 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:34.662405+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:35.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:35 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:34.663399+0000 mgr.y (mgr.24871) 38 : cephadm [INF] Reconfiguring daemon osd.1 on smithi062 2024-02-22T19:15:35.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:35 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:34.663758+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2024-02-22T19:15:35.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:35 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:34.660900+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:35.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:35 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:34.661615+0000 mgr.y (mgr.24871) 37 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2024-02-22T19:15:35.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:35 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:34.661851+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-22T19:15:35.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:35 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:34.662405+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:35.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:35 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:34.663399+0000 mgr.y (mgr.24871) 38 : cephadm [INF] Reconfiguring daemon osd.1 on smithi062 2024-02-22T19:15:35.985 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:35 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:34.663758+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2024-02-22T19:15:37.371 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:37 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:35.819236+0000 mgr.y (mgr.24871) 39 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:37.371 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:37 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:36.081750+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:37.371 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:37 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:36.082468+0000 mgr.y (mgr.24871) 40 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2024-02-22T19:15:37.371 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:37 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:36.082726+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-22T19:15:37.372 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:37 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:36.083361+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:37.372 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:37 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:36.084405+0000 mgr.y (mgr.24871) 41 : cephadm [INF] Reconfiguring daemon osd.2 on smithi062 2024-02-22T19:15:37.372 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:37 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:36.084783+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2024-02-22T19:15:37.372 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:37 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:35.819236+0000 mgr.y (mgr.24871) 39 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:37.372 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:37 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:36.081750+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:37.372 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:37 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:36.082468+0000 mgr.y (mgr.24871) 40 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2024-02-22T19:15:37.372 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:37 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:36.082726+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-22T19:15:37.372 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:37 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:36.083361+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:37.372 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:37 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:36.084405+0000 mgr.y (mgr.24871) 41 : cephadm [INF] Reconfiguring daemon osd.2 on smithi062 2024-02-22T19:15:37.372 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:37 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:36.084783+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2024-02-22T19:15:37.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:37 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:35.819236+0000 mgr.y (mgr.24871) 39 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:37.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:37 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:36.081750+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:37.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:37 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:36.082468+0000 mgr.y (mgr.24871) 40 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2024-02-22T19:15:37.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:37 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:36.082726+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-22T19:15:37.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:37 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:36.083361+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:37.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:37 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:36.084405+0000 mgr.y (mgr.24871) 41 : cephadm [INF] Reconfiguring daemon osd.2 on smithi062 2024-02-22T19:15:37.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:37 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:36.084783+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2024-02-22T19:15:38.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:38 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:37.439577+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:38.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:38 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:37.440317+0000 mgr.y (mgr.24871) 42 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2024-02-22T19:15:38.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:38 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:37.440555+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-22T19:15:38.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:38 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:37.441125+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:38.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:38 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:37.442065+0000 mgr.y (mgr.24871) 43 : cephadm [INF] Reconfiguring daemon osd.3 on smithi062 2024-02-22T19:15:38.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:38 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:37.442382+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2024-02-22T19:15:38.714 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:38 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:37.820074+0000 mgr.y (mgr.24871) 44 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:38.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:38 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:37.439577+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:38.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:38 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:37.440317+0000 mgr.y (mgr.24871) 42 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2024-02-22T19:15:38.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:38 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:37.440555+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-22T19:15:38.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:38 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:37.441125+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:38.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:38 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:37.442065+0000 mgr.y (mgr.24871) 43 : cephadm [INF] Reconfiguring daemon osd.3 on smithi062 2024-02-22T19:15:38.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:38 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:37.442382+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2024-02-22T19:15:38.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:38 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:37.820074+0000 mgr.y (mgr.24871) 44 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:38.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:38 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:37.439577+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:38.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:38 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:37.440317+0000 mgr.y (mgr.24871) 42 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2024-02-22T19:15:38.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:38 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:37.440555+0000 mon.a (mon.0) 177 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-22T19:15:38.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:38 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:37.441125+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:38.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:38 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:37.442065+0000 mgr.y (mgr.24871) 43 : cephadm [INF] Reconfiguring daemon osd.3 on smithi062 2024-02-22T19:15:38.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:38 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:37.442382+0000 mon.a (mon.0) 179 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2024-02-22T19:15:38.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:38 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:37.820074+0000 mgr.y (mgr.24871) 44 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:40.193 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:38.843219+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:40.194 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:38.844311+0000 mgr.y (mgr.24871) 45 : cephadm [INF] Reconfiguring rgw.r.z.smithi062.zxmpna (monmap changed)... 2024-02-22T19:15:40.194 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:38.844598+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi062.zxmpna", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T19:15:40.194 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:38.845321+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi062.zxmpna", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T19:15:40.194 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:38.850725+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi062.zxmpna", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-22T19:15:40.194 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:38.851259+0000 mgr.y (mgr.24871) 46 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi062.zxmpna 2024-02-22T19:15:40.194 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:38.858162+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:40.194 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:38.858797+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi062.zxmpna"}]: dispatch 2024-02-22T19:15:40.194 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:38.859307+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:40.194 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:38.859863+0000 mgr.y (mgr.24871) 47 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi062.zxmpna on smithi062 2024-02-22T19:15:40.194 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:38.860247+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi062.zxmpna","key": "container_image"}]: dispatch 2024-02-22T19:15:40.194 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:38.843219+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:40.195 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:38.844311+0000 mgr.y (mgr.24871) 45 : cephadm [INF] Reconfiguring rgw.r.z.smithi062.zxmpna (monmap changed)... 2024-02-22T19:15:40.195 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:38.844598+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi062.zxmpna", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T19:15:40.195 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:38.845321+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi062.zxmpna", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T19:15:40.195 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:38.850725+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi062.zxmpna", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-22T19:15:40.195 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:38.851259+0000 mgr.y (mgr.24871) 46 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi062.zxmpna 2024-02-22T19:15:40.195 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:38.858162+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:40.195 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:38.858797+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi062.zxmpna"}]: dispatch 2024-02-22T19:15:40.195 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:38.859307+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:40.195 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:38.859863+0000 mgr.y (mgr.24871) 47 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi062.zxmpna on smithi062 2024-02-22T19:15:40.195 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:39 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:38.860247+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi062.zxmpna","key": "container_image"}]: dispatch 2024-02-22T19:15:40.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:39 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:38.843219+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:40.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:39 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:38.844311+0000 mgr.y (mgr.24871) 45 : cephadm [INF] Reconfiguring rgw.r.z.smithi062.zxmpna (monmap changed)... 2024-02-22T19:15:40.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:39 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:38.844598+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi062.zxmpna", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T19:15:40.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:39 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:38.845321+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi062.zxmpna", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T19:15:40.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:39 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:38.850725+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi062.zxmpna", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-22T19:15:40.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:39 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:38.851259+0000 mgr.y (mgr.24871) 46 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi062.zxmpna 2024-02-22T19:15:40.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:39 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:38.858162+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:40.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:39 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:38.858797+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi062.zxmpna"}]: dispatch 2024-02-22T19:15:40.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:39 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:38.859307+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:40.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:39 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:38.859863+0000 mgr.y (mgr.24871) 47 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi062.zxmpna on smithi062 2024-02-22T19:15:40.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:39 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:38.860247+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi062.zxmpna","key": "container_image"}]: dispatch 2024-02-22T19:15:40.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:40 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:39.820390+0000 mgr.y (mgr.24871) 48 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:40.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:40 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:40.240513+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:40.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:40 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:40.241506+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:15:40.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:40 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:40.242089+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:15:40.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:40 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:40.242628+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:40.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:40 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:40.243443+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-22T19:15:41.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:40 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:39.820390+0000 mgr.y (mgr.24871) 48 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:41.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:40 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:40.240513+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:41.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:40 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:40.241506+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:15:41.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:40 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:40.242089+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:15:41.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:40 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:40.242628+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:41.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:40 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:40.243443+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-22T19:15:41.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:40 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:39.820390+0000 mgr.y (mgr.24871) 48 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:41.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:40 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:40.240513+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:41.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:40 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:40.241506+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-22T19:15:41.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:40 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:40.242089+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-22T19:15:41.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:40 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:40.242628+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:41.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:40 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:40.243443+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-22T19:15:42.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:41 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:40.241275+0000 mgr.y (mgr.24871) 49 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-22T19:15:42.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:41 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:40.243121+0000 mgr.y (mgr.24871) 50 : cephadm [INF] Reconfiguring daemon mon.b on smithi063 2024-02-22T19:15:42.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:41 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:41.622517+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:42.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:41 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:41.623749+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:15:42.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:41 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:41.624664+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T19:15:42.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:41 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:41.625385+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:42.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:41 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:41.626502+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-22T19:15:42.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:41 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:40.241275+0000 mgr.y (mgr.24871) 49 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-22T19:15:42.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:41 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:40.243121+0000 mgr.y (mgr.24871) 50 : cephadm [INF] Reconfiguring daemon mon.b on smithi063 2024-02-22T19:15:42.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:41 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:41.622517+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:42.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:41 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:41.623749+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:15:42.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:41 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:41.624664+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T19:15:42.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:41 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:41.625385+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:42.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:41 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:41.626502+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-22T19:15:42.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:41 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:40.241275+0000 mgr.y (mgr.24871) 49 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-22T19:15:42.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:41 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:40.243121+0000 mgr.y (mgr.24871) 50 : cephadm [INF] Reconfiguring daemon mon.b on smithi063 2024-02-22T19:15:42.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:41 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:41.622517+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:42.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:41 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:41.623749+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-22T19:15:42.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:41 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:41.624664+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-22T19:15:42.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:41 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:41.625385+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:42.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:41 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:41.626502+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-22T19:15:42.960 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:42 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:41.623401+0000 mgr.y (mgr.24871) 51 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2024-02-22T19:15:42.960 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:42 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:41.626065+0000 mgr.y (mgr.24871) 52 : cephadm [INF] Reconfiguring daemon mgr.x on smithi063 2024-02-22T19:15:42.960 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:42 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:41.821262+0000 mgr.y (mgr.24871) 53 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:43.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:41.623401+0000 mgr.y (mgr.24871) 51 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2024-02-22T19:15:43.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:41.626065+0000 mgr.y (mgr.24871) 52 : cephadm [INF] Reconfiguring daemon mgr.x on smithi063 2024-02-22T19:15:43.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:41.821262+0000 mgr.y (mgr.24871) 53 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:43.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:41.623401+0000 mgr.y (mgr.24871) 51 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2024-02-22T19:15:43.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:41.626065+0000 mgr.y (mgr.24871) 52 : cephadm [INF] Reconfiguring daemon mgr.x on smithi063 2024-02-22T19:15:43.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:42 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:41.821262+0000 mgr.y (mgr.24871) 53 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:44.333 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:44 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:43.023560+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:44.333 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:44 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:43.024408+0000 mgr.y (mgr.24871) 54 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2024-02-22T19:15:44.333 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:44 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:43.024733+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-22T19:15:44.333 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:44 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:43.025552+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:44.333 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:44 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:43.026869+0000 mgr.y (mgr.24871) 55 : cephadm [INF] Reconfiguring daemon osd.4 on smithi063 2024-02-22T19:15:44.333 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:44 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:43.027368+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2024-02-22T19:15:44.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:43.023560+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:44.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:43.024408+0000 mgr.y (mgr.24871) 54 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2024-02-22T19:15:44.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:43.024733+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-22T19:15:44.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:43.025552+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:44.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:43.026869+0000 mgr.y (mgr.24871) 55 : cephadm [INF] Reconfiguring daemon osd.4 on smithi063 2024-02-22T19:15:44.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:43.027368+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2024-02-22T19:15:44.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:43.023560+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:44.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:43.024408+0000 mgr.y (mgr.24871) 54 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2024-02-22T19:15:44.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:43.024733+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-22T19:15:44.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:43.025552+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:44.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:43.026869+0000 mgr.y (mgr.24871) 55 : cephadm [INF] Reconfiguring daemon osd.4 on smithi063 2024-02-22T19:15:44.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:44 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:43.027368+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2024-02-22T19:15:45.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:45 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:43.821819+0000 mgr.y (mgr.24871) 56 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:45.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:45 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:44.387545+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:45.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:45 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:44.388545+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-22T19:15:45.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:45 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:44.389251+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:45.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:45 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:44.390917+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2024-02-22T19:15:45.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:45 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:43.821819+0000 mgr.y (mgr.24871) 56 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:45.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:45 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:44.387545+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:45.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:45 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:44.388545+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-22T19:15:45.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:45 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:44.389251+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:45.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:45 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:44.390917+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2024-02-22T19:15:45.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:45 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:43.821819+0000 mgr.y (mgr.24871) 56 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:45.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:45 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:44.387545+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:45.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:45 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:44.388545+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-22T19:15:45.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:45 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:44.389251+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:45.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:45 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:44.390917+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2024-02-22T19:15:46.292 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:46 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:44.388286+0000 mgr.y (mgr.24871) 57 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2024-02-22T19:15:46.292 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:46 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:44.390478+0000 mgr.y (mgr.24871) 58 : cephadm [INF] Reconfiguring daemon osd.5 on smithi063 2024-02-22T19:15:46.292 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:46 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:45.791842+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:46.292 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:46 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:45.793017+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-22T19:15:46.292 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:46 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:45.793785+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:46.293 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:46 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:45.795515+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2024-02-22T19:15:46.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:46 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:44.388286+0000 mgr.y (mgr.24871) 57 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2024-02-22T19:15:46.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:46 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:44.390478+0000 mgr.y (mgr.24871) 58 : cephadm [INF] Reconfiguring daemon osd.5 on smithi063 2024-02-22T19:15:46.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:46 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:45.791842+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:46.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:46 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:45.793017+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-22T19:15:46.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:46 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:45.793785+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:46.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:46 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:45.795515+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2024-02-22T19:15:46.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:46 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:44.388286+0000 mgr.y (mgr.24871) 57 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2024-02-22T19:15:46.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:46 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:44.390478+0000 mgr.y (mgr.24871) 58 : cephadm [INF] Reconfiguring daemon osd.5 on smithi063 2024-02-22T19:15:46.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:46 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:45.791842+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:46.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:46 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:45.793017+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-22T19:15:46.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:46 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:45.793785+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:46.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:46 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:45.795515+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2024-02-22T19:15:47.086 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:47 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:45.792705+0000 mgr.y (mgr.24871) 59 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2024-02-22T19:15:47.086 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:47 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:45.795039+0000 mgr.y (mgr.24871) 60 : cephadm [INF] Reconfiguring daemon osd.6 on smithi063 2024-02-22T19:15:47.087 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:47 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:45.822321+0000 mgr.y (mgr.24871) 61 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:47.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:47 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:45.792705+0000 mgr.y (mgr.24871) 59 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2024-02-22T19:15:47.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:47 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:45.795039+0000 mgr.y (mgr.24871) 60 : cephadm [INF] Reconfiguring daemon osd.6 on smithi063 2024-02-22T19:15:47.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:47 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:45.822321+0000 mgr.y (mgr.24871) 61 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:47.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:47 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:45.792705+0000 mgr.y (mgr.24871) 59 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2024-02-22T19:15:47.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:47 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:45.795039+0000 mgr.y (mgr.24871) 60 : cephadm [INF] Reconfiguring daemon osd.6 on smithi063 2024-02-22T19:15:47.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:47 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:45.822321+0000 mgr.y (mgr.24871) 61 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:48.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:48 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:47.161422+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:48.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:48 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:47.162356+0000 mgr.y (mgr.24871) 62 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2024-02-22T19:15:48.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:48 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:47.162729+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-22T19:15:48.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:48 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:47.163555+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:48.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:48 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:47.164916+0000 mgr.y (mgr.24871) 63 : cephadm [INF] Reconfiguring daemon osd.7 on smithi063 2024-02-22T19:15:48.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:48 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:47.165472+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2024-02-22T19:15:48.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:48 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:47.161422+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:48.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:48 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:47.162356+0000 mgr.y (mgr.24871) 62 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2024-02-22T19:15:48.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:48 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:47.162729+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-22T19:15:48.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:48 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:47.163555+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:48.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:48 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:47.164916+0000 mgr.y (mgr.24871) 63 : cephadm [INF] Reconfiguring daemon osd.7 on smithi063 2024-02-22T19:15:48.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:48 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:47.165472+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2024-02-22T19:15:48.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:48 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:47.161422+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:48.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:48 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:47.162356+0000 mgr.y (mgr.24871) 62 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2024-02-22T19:15:48.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:48 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:47.162729+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-22T19:15:48.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:48 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:47.163555+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:48.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:48 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:47.164916+0000 mgr.y (mgr.24871) 63 : cephadm [INF] Reconfiguring daemon osd.7 on smithi063 2024-02-22T19:15:48.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:48 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:47.165472+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2024-02-22T19:15:49.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:49 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:47.822942+0000 mgr.y (mgr.24871) 64 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:49.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:49 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:48.676830+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:49.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:49 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:48.678624+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi063.feyald", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T19:15:49.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:49 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:48.679675+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi063.feyald", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T19:15:49.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:49 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:48.683003+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi063.feyald", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-22T19:15:49.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:49 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:48.687411+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:49.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:49 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:48.688205+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi063.feyald"}]: dispatch 2024-02-22T19:15:49.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:49 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:48.688903+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:49.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:49 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:48.690052+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi063.feyald","key": "container_image"}]: dispatch 2024-02-22T19:15:49.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:47.822942+0000 mgr.y (mgr.24871) 64 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:49.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:48.676830+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:49.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:48.678624+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi063.feyald", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T19:15:49.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:48.679675+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi063.feyald", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T19:15:49.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:48.683003+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi063.feyald", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-22T19:15:49.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:48.687411+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:49.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:48.688205+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi063.feyald"}]: dispatch 2024-02-22T19:15:49.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:48.688903+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:49.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:48.690052+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi063.feyald","key": "container_image"}]: dispatch 2024-02-22T19:15:49.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:47.822942+0000 mgr.y (mgr.24871) 64 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:49.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:48.676830+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:49.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:48.678624+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi063.feyald", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T19:15:49.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:48.679675+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi063.feyald", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-22T19:15:49.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:48.683003+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi063.feyald", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-22T19:15:49.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:48.687411+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:49.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:48.688205+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi063.feyald"}]: dispatch 2024-02-22T19:15:49.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:48.688903+0000 mon.a (mon.0) 220 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:49.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:49 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:48.690052+0000 mon.a (mon.0) 221 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi063.feyald","key": "container_image"}]: dispatch 2024-02-22T19:15:50.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:50 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:48.678205+0000 mgr.y (mgr.24871) 65 : cephadm [INF] Reconfiguring rgw.r.z.smithi063.feyald (monmap changed)... 2024-02-22T19:15:50.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:50 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:48.683727+0000 mgr.y (mgr.24871) 66 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi063.feyald 2024-02-22T19:15:50.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:50 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:48.689587+0000 mgr.y (mgr.24871) 67 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi063.feyald on smithi063 2024-02-22T19:15:50.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:50 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:50.031264+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:50.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:50 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:50.033141+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:15:50.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:50 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:50.035981+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:15:50.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:50 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:50.037667+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:15:50.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:50 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:50.042911+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:50.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:50 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:50.043787+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-22T19:15:50.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:50 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:50.047579+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-02-22T19:15:50.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:50 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:50.048394+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-22T19:15:50.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:50 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:50.052980+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-02-22T19:15:50.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:50 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:50.053759+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-22T19:15:50.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:50 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:50.058246+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-02-22T19:15:50.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:50 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:50.059506+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:15:50.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:50 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:50.063574+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:50.465 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:50 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:50.065068+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-22T19:15:50.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:48.678205+0000 mgr.y (mgr.24871) 65 : cephadm [INF] Reconfiguring rgw.r.z.smithi063.feyald (monmap changed)... 2024-02-22T19:15:50.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:48.683727+0000 mgr.y (mgr.24871) 66 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi063.feyald 2024-02-22T19:15:50.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:48.689587+0000 mgr.y (mgr.24871) 67 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi063.feyald on smithi063 2024-02-22T19:15:50.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:50.031264+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:50.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:50.033141+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:15:50.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:50.035981+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:15:50.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:50.037667+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:15:50.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:50.042911+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:50.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:50.043787+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-22T19:15:50.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:50.047579+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-02-22T19:15:50.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:50.048394+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-22T19:15:50.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:50.052980+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-02-22T19:15:50.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:50.053759+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-22T19:15:50.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:50.058246+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-02-22T19:15:50.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:50.059506+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:15:50.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:50.063574+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:50.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:50.065068+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-22T19:15:50.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:48.678205+0000 mgr.y (mgr.24871) 65 : cephadm [INF] Reconfiguring rgw.r.z.smithi063.feyald (monmap changed)... 2024-02-22T19:15:50.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:48.683727+0000 mgr.y (mgr.24871) 66 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi063.feyald 2024-02-22T19:15:50.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:48.689587+0000 mgr.y (mgr.24871) 67 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi063.feyald on smithi063 2024-02-22T19:15:50.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:50.031264+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:50.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:50.033141+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:15:50.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:50.035981+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:15:50.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:50.037667+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:15:50.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:50.042911+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:50.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:50.043787+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-22T19:15:50.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:50.047579+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-02-22T19:15:50.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:50.048394+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-22T19:15:50.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:50.052980+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-02-22T19:15:50.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:50.053759+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-22T19:15:50.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:50.058246+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-02-22T19:15:50.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:50.059506+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:15:50.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:50.063574+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:50.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:50 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:50.065068+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-22T19:15:51.449 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:51 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:49.823411+0000 mgr.y (mgr.24871) 68 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:51.450 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:51 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:50.038394+0000 mgr.y (mgr.24871) 69 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-22T19:15:51.450 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:51 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:50.060252+0000 mgr.y (mgr.24871) 70 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-22T19:15:51.450 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:51 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:50.065223+0000 mgr.y (mgr.24871) 71 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-22T19:15:51.450 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:51 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:50.066153+0000 mgr.y (mgr.24871) 72 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-02-22T19:15:51.450 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:51 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:49.823411+0000 mgr.y (mgr.24871) 68 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:51.450 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:51 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:50.038394+0000 mgr.y (mgr.24871) 69 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-22T19:15:51.450 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:51 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:50.060252+0000 mgr.y (mgr.24871) 70 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-22T19:15:51.450 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:51 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:50.065223+0000 mgr.y (mgr.24871) 71 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-22T19:15:51.450 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:51 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:50.066153+0000 mgr.y (mgr.24871) 72 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-02-22T19:15:51.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:51 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:49.823411+0000 mgr.y (mgr.24871) 68 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:51.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:51 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:50.038394+0000 mgr.y (mgr.24871) 69 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-22T19:15:51.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:51 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:50.060252+0000 mgr.y (mgr.24871) 70 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-22T19:15:51.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:51 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:50.065223+0000 mgr.y (mgr.24871) 71 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-22T19:15:51.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:51 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:50.066153+0000 mgr.y (mgr.24871) 72 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-02-22T19:15:52.734 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:52 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:51.469762+0000 mgr.y (mgr.24871) 73 : cephadm [INF] Upgrade: Updating osd.0 2024-02-22T19:15:52.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:52 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:51.473787+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:52.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:52 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:51.474539+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-22T19:15:52.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:52 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:51.475132+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:52.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:52 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:15:51.476629+0000 mgr.y (mgr.24871) 74 : cephadm [INF] Deploying daemon osd.0 on smithi062 2024-02-22T19:15:52.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:52 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:51.477137+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-02-22T19:15:52.735 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:52 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:51.824209+0000 mgr.y (mgr.24871) 75 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:52.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:52 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:51.469762+0000 mgr.y (mgr.24871) 73 : cephadm [INF] Upgrade: Updating osd.0 2024-02-22T19:15:52.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:52 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:51.473787+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:52.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:52 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:51.474539+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-22T19:15:52.735 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:52 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:51.475132+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:52.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:52 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:15:51.476629+0000 mgr.y (mgr.24871) 74 : cephadm [INF] Deploying daemon osd.0 on smithi062 2024-02-22T19:15:52.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:52 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:51.477137+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-02-22T19:15:52.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:52 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:51.824209+0000 mgr.y (mgr.24871) 75 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:52.963 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:52 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:51.469762+0000 mgr.y (mgr.24871) 73 : cephadm [INF] Upgrade: Updating osd.0 2024-02-22T19:15:52.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:52 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:51.473787+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:15:52.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:52 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:51.474539+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-22T19:15:52.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:52 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:51.475132+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-22T19:15:52.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:52 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:15:51.476629+0000 mgr.y (mgr.24871) 74 : cephadm [INF] Deploying daemon osd.0 on smithi062 2024-02-22T19:15:52.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:52 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:51.477137+0000 mon.a (mon.0) 239 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-02-22T19:15:52.964 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:52 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:51.824209+0000 mgr.y (mgr.24871) 75 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:54.390 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:15:54 smithi062 systemd[1]: Stopping Ceph osd.0 for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:15:54.645 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:15:54 smithi062 bash[69823]: debug 2024-02-22T19:15:54.388+0000 7fdfddaf4700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:15:54.645 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:15:54 smithi062 bash[69823]: debug 2024-02-22T19:15:54.388+0000 7fdfddaf4700 -1 osd.0 63 *** Got signal Terminated *** 2024-02-22T19:15:54.645 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:15:54 smithi062 bash[69823]: debug 2024-02-22T19:15:54.388+0000 7fdfddaf4700 -1 osd.0 63 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T19:15:54.895 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:15:54 smithi062 bash[93013]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-osd.0 2024-02-22T19:15:54.895 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:53.824676+0000 mgr.y (mgr.24871) 76 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:54.896 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.431006+0000 mon.a (mon.0) 240 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-22T19:15:54.896 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.431035+0000 mon.a (mon.0) 241 : cluster [INF] osd.0 failed (root=default,host=smithi062) (connection refused reported by osd.6) 2024-02-22T19:15:54.896 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.431167+0000 mon.a (mon.0) 242 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-22T19:15:54.896 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.431237+0000 mon.a (mon.0) 243 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-22T19:15:54.896 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.431413+0000 mon.a (mon.0) 244 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-22T19:15:54.896 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.431498+0000 mon.a (mon.0) 245 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-22T19:15:54.896 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.631710+0000 mon.a (mon.0) 246 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-22T19:15:54.896 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.631799+0000 mon.a (mon.0) 247 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-22T19:15:54.896 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.632016+0000 mon.a (mon.0) 248 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-22T19:15:54.896 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.632119+0000 mon.a (mon.0) 249 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-22T19:15:54.896 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.632163+0000 mon.a (mon.0) 250 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-22T19:15:54.896 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.632262+0000 mon.a (mon.0) 251 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-22T19:15:54.897 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.632330+0000 mon.a (mon.0) 252 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-22T19:15:54.897 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.632400+0000 mon.a (mon.0) 253 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-22T19:15:54.897 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.632483+0000 mon.a (mon.0) 254 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-22T19:15:54.897 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.632552+0000 mon.a (mon.0) 255 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-22T19:15:54.897 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.632668+0000 mon.a (mon.0) 256 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-22T19:15:54.897 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.632763+0000 mon.a (mon.0) 257 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-22T19:15:54.897 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.632840+0000 mon.a (mon.0) 258 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-22T19:15:54.897 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.632935+0000 mon.a (mon.0) 259 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-22T19:15:54.897 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:53.824676+0000 mgr.y (mgr.24871) 76 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:54.897 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.431006+0000 mon.a (mon.0) 240 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-22T19:15:54.897 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.431035+0000 mon.a (mon.0) 241 : cluster [INF] osd.0 failed (root=default,host=smithi062) (connection refused reported by osd.6) 2024-02-22T19:15:54.897 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.431167+0000 mon.a (mon.0) 242 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-22T19:15:54.897 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.431237+0000 mon.a (mon.0) 243 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-22T19:15:54.898 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.431413+0000 mon.a (mon.0) 244 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-22T19:15:54.898 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.431498+0000 mon.a (mon.0) 245 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-22T19:15:54.898 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.631710+0000 mon.a (mon.0) 246 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-22T19:15:54.898 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.631799+0000 mon.a (mon.0) 247 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-22T19:15:54.898 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.632016+0000 mon.a (mon.0) 248 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-22T19:15:54.898 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.632119+0000 mon.a (mon.0) 249 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-22T19:15:54.898 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.632163+0000 mon.a (mon.0) 250 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-22T19:15:54.898 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.632262+0000 mon.a (mon.0) 251 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-22T19:15:54.898 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.632330+0000 mon.a (mon.0) 252 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-22T19:15:54.898 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.632400+0000 mon.a (mon.0) 253 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-22T19:15:54.898 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.632483+0000 mon.a (mon.0) 254 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-22T19:15:54.898 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.632552+0000 mon.a (mon.0) 255 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-22T19:15:54.898 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.632668+0000 mon.a (mon.0) 256 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-22T19:15:54.898 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.632763+0000 mon.a (mon.0) 257 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-22T19:15:54.898 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.632840+0000 mon.a (mon.0) 258 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-22T19:15:54.898 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:54 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.632935+0000 mon.a (mon.0) 259 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-22T19:15:55.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:53.824676+0000 mgr.y (mgr.24871) 76 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:55.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.431006+0000 mon.a (mon.0) 240 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-22T19:15:55.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.431035+0000 mon.a (mon.0) 241 : cluster [INF] osd.0 failed (root=default,host=smithi062) (connection refused reported by osd.6) 2024-02-22T19:15:55.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.431167+0000 mon.a (mon.0) 242 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-22T19:15:55.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.431237+0000 mon.a (mon.0) 243 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-22T19:15:55.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.431413+0000 mon.a (mon.0) 244 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-22T19:15:55.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.431498+0000 mon.a (mon.0) 245 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-22T19:15:55.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.631710+0000 mon.a (mon.0) 246 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-22T19:15:55.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.631799+0000 mon.a (mon.0) 247 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-22T19:15:55.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.632016+0000 mon.a (mon.0) 248 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-22T19:15:55.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.632119+0000 mon.a (mon.0) 249 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-22T19:15:55.215 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.632163+0000 mon.a (mon.0) 250 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-22T19:15:55.215 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.632262+0000 mon.a (mon.0) 251 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-22T19:15:55.215 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.632330+0000 mon.a (mon.0) 252 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-22T19:15:55.215 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.632400+0000 mon.a (mon.0) 253 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-22T19:15:55.215 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.632483+0000 mon.a (mon.0) 254 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-22T19:15:55.215 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.632552+0000 mon.a (mon.0) 255 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-22T19:15:55.215 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.632668+0000 mon.a (mon.0) 256 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-22T19:15:55.215 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.632763+0000 mon.a (mon.0) 257 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-22T19:15:55.215 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.632840+0000 mon.a (mon.0) 258 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-22T19:15:55.215 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:54 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.632935+0000 mon.a (mon.0) 259 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-22T19:15:56.204 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.877221+0000 mon.a (mon.0) 260 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-22T19:15:56.205 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:54.883965+0000 mon.a (mon.0) 261 : cluster [DBG] osdmap e64: 8 total, 7 up, 8 in 2024-02-22T19:15:56.205 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:54.886209+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T19:15:56.205 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:54.889774+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T19:15:56.205 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:55.849485+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2024-02-22T19:15:56.205 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:55.849805+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.0", "id": [4, 6]}]: dispatch 2024-02-22T19:15:56.205 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:55.850078+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.4", "id": [7, 0]}]: dispatch 2024-02-22T19:15:56.205 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:55.850343+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.11", "id": [4, 0]}]: dispatch 2024-02-22T19:15:56.205 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:55.850609+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.12", "id": [1, 0]}]: dispatch 2024-02-22T19:15:56.205 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:55.850886+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.19", "id": [5, 0]}]: dispatch 2024-02-22T19:15:56.205 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:55.851147+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1a", "id": [1, 6, 7, 0]}]: dispatch 2024-02-22T19:15:56.205 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:55.851432+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1b", "id": [5, 2]}]: dispatch 2024-02-22T19:15:56.205 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:55.851696+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1d", "id": [4, 3]}]: dispatch 2024-02-22T19:15:56.205 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:55.887585+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-22T19:15:56.205 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:55.887829+0000 mon.a (mon.0) 274 : cluster [DBG] osdmap e65: 8 total, 7 up, 8 in 2024-02-22T19:15:56.206 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.877221+0000 mon.a (mon.0) 260 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-22T19:15:56.206 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:54.883965+0000 mon.a (mon.0) 261 : cluster [DBG] osdmap e64: 8 total, 7 up, 8 in 2024-02-22T19:15:56.206 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:54.886209+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T19:15:56.206 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:54.889774+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T19:15:56.206 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:55.849485+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2024-02-22T19:15:56.206 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:55.849805+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.0", "id": [4, 6]}]: dispatch 2024-02-22T19:15:56.206 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:55.850078+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.4", "id": [7, 0]}]: dispatch 2024-02-22T19:15:56.206 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:55.850343+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.11", "id": [4, 0]}]: dispatch 2024-02-22T19:15:56.206 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:55.850609+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.12", "id": [1, 0]}]: dispatch 2024-02-22T19:15:56.206 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:55.850886+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.19", "id": [5, 0]}]: dispatch 2024-02-22T19:15:56.206 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:55.851147+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1a", "id": [1, 6, 7, 0]}]: dispatch 2024-02-22T19:15:56.206 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:55.851432+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1b", "id": [5, 2]}]: dispatch 2024-02-22T19:15:56.206 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:55.851696+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1d", "id": [4, 3]}]: dispatch 2024-02-22T19:15:56.207 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:55.887585+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-22T19:15:56.207 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:55 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:55.887829+0000 mon.a (mon.0) 274 : cluster [DBG] osdmap e65: 8 total, 7 up, 8 in 2024-02-22T19:15:56.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:55 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.877221+0000 mon.a (mon.0) 260 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-22T19:15:56.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:55 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:54.883965+0000 mon.a (mon.0) 261 : cluster [DBG] osdmap e64: 8 total, 7 up, 8 in 2024-02-22T19:15:56.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:55 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:54.886209+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-22T19:15:56.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:55 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:54.889774+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-22T19:15:56.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:55 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:55.849485+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2024-02-22T19:15:56.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:55 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:55.849805+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.0", "id": [4, 6]}]: dispatch 2024-02-22T19:15:56.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:55 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:55.850078+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.4", "id": [7, 0]}]: dispatch 2024-02-22T19:15:56.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:55 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:55.850343+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.11", "id": [4, 0]}]: dispatch 2024-02-22T19:15:56.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:55 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:55.850609+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.12", "id": [1, 0]}]: dispatch 2024-02-22T19:15:56.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:55 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:55.850886+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.19", "id": [5, 0]}]: dispatch 2024-02-22T19:15:56.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:55 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:55.851147+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1a", "id": [1, 6, 7, 0]}]: dispatch 2024-02-22T19:15:56.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:55 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:55.851432+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1b", "id": [5, 2]}]: dispatch 2024-02-22T19:15:56.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:55 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:55.851696+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1d", "id": [4, 3]}]: dispatch 2024-02-22T19:15:56.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:55 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:55.887585+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-22T19:15:56.214 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:55 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:55.887829+0000 mon.a (mon.0) 274 : cluster [DBG] osdmap e65: 8 total, 7 up, 8 in 2024-02-22T19:15:57.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:56 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:55.825080+0000 mgr.y (mgr.24871) 77 : cluster [DBG] pgmap v34: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:57.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:56 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:55.825080+0000 mgr.y (mgr.24871) 77 : cluster [DBG] pgmap v34: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:57.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:56 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:55.825080+0000 mgr.y (mgr.24871) 77 : cluster [DBG] pgmap v34: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-22T19:15:57.235 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:15:56 smithi062 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.0.service: Succeeded. 2024-02-22T19:15:57.235 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:15:56 smithi062 systemd[1]: Stopped Ceph osd.0 for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:15:57.235 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:15:56 smithi062 systemd[1]: Starting Ceph osd.0 for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:15:58.127 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:57 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:57.904974+0000 mon.a (mon.0) 275 : cluster [WRN] Health check failed: Degraded data redundancy: 66/606 objects degraded (10.891%), 20 pgs degraded (PG_DEGRADED) 2024-02-22T19:15:58.128 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:57 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:57.904974+0000 mon.a (mon.0) 275 : cluster [WRN] Health check failed: Degraded data redundancy: 66/606 objects degraded (10.891%), 20 pgs degraded (PG_DEGRADED) 2024-02-22T19:15:58.128 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:15:57 smithi062 bash[93316]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-22T19:15:58.128 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:15:57 smithi062 bash[93316]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-22T19:15:58.128 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:15:57 smithi062 bash[93316]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-02-22T19:15:58.128 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:15:57 smithi062 bash[93316]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-22T19:15:58.128 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:15:57 smithi062 bash[93316]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-02-22T19:15:58.128 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:15:57 smithi062 bash[93316]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-22T19:15:58.128 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:15:57 smithi062 bash[93316]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-22T19:15:58.128 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:15:57 smithi062 bash[93316]: --> ceph-volume lvm activate successful for osd ID: 0 2024-02-22T19:15:58.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:57 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:57.904974+0000 mon.a (mon.0) 275 : cluster [WRN] Health check failed: Degraded data redundancy: 66/606 objects degraded (10.891%), 20 pgs degraded (PG_DEGRADED) 2024-02-22T19:15:59.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:15:58 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:57.826032+0000 mgr.y (mgr.24871) 78 : cluster [DBG] pgmap v36: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 66/606 objects degraded (10.891%) 2024-02-22T19:15:59.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:15:58 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:57.826032+0000 mgr.y (mgr.24871) 78 : cluster [DBG] pgmap v36: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 66/606 objects degraded (10.891%) 2024-02-22T19:15:59.234 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:15:58 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-osd-0[93603]: debug 2024-02-22T19:15:58.887+0000 7f6ab29bb700 1 -- 172.21.15.62:0/4143398218 <== mon.0 v2:172.21.15.62:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5651a6e02680 con 0x5651a6dc9400 2024-02-22T19:15:59.234 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:15:58 smithi062 bash[93588]: f27f0b6a9863eb0c746af8c91cb75cf5c010f6a27d60326235825efecbc9dbe0 2024-02-22T19:15:59.234 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:15:58 smithi062 systemd[1]: Started Ceph osd.0 for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:15:59.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:15:58 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:57.826032+0000 mgr.y (mgr.24871) 78 : cluster [DBG] pgmap v36: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 66/606 objects degraded (10.891%) 2024-02-22T19:15:59.734 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:15:59 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-osd-0[93603]: debug 2024-02-22T19:15:59.413+0000 7f6aba449380 -1 Falling back to public interface 2024-02-22T19:16:00.444 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:00 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:59.019881+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:16:00.444 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:00 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:59.020649+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:16:00.444 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:00 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:15:59.021928+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:16:00.444 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:00 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:59.019881+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:16:00.444 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:00 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:59.020649+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:16:00.444 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:00 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:15:59.021928+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:16:00.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:00 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:59.019881+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:16:00.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:00 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:59.020649+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:16:00.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:00 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:15:59.021928+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-22T19:16:01.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:01 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:15:59.826691+0000 mgr.y (mgr.24871) 79 : cluster [DBG] pgmap v37: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 66/606 objects degraded (10.891%) 2024-02-22T19:16:01.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:01 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:15:59.826691+0000 mgr.y (mgr.24871) 79 : cluster [DBG] pgmap v37: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 66/606 objects degraded (10.891%) 2024-02-22T19:16:01.586 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:01 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:15:59.826691+0000 mgr.y (mgr.24871) 79 : cluster [DBG] pgmap v37: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 66/606 objects degraded (10.891%) 2024-02-22T19:16:02.484 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:16:02 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-osd-0[93603]: debug 2024-02-22T19:16:02.155+0000 7f6aba449380 -1 osd.0 63 log_to_monitors {default=true} 2024-02-22T19:16:03.234 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:16:03 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-osd-0[93603]: debug 2024-02-22T19:16:03.054+0000 7f6aa992c700 -1 osd.0 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-22T19:16:03.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:03 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:16:01.827341+0000 mgr.y (mgr.24871) 80 : cluster [DBG] pgmap v38: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 66/606 objects degraded (10.891%) 2024-02-22T19:16:03.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:03 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:02.159823+0000 mon.a (mon.0) 279 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/2635822624,v1:172.21.15.62:6803/2635822624]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-22T19:16:03.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:03 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:16:01.827341+0000 mgr.y (mgr.24871) 80 : cluster [DBG] pgmap v38: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 66/606 objects degraded (10.891%) 2024-02-22T19:16:03.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:03 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:02.159823+0000 mon.a (mon.0) 279 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/2635822624,v1:172.21.15.62:6803/2635822624]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-22T19:16:03.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:03 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:16:01.827341+0000 mgr.y (mgr.24871) 80 : cluster [DBG] pgmap v38: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 5.7 MiB used, 707 GiB / 715 GiB avail; 66/606 objects degraded (10.891%) 2024-02-22T19:16:03.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:03 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:02.159823+0000 mon.a (mon.0) 279 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/2635822624,v1:172.21.15.62:6803/2635822624]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-22T19:16:03.734 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:16:03 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:16:03.293+0000 7f84665ff700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-02-22T19:16:04.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:04 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:03.035523+0000 mon.a (mon.0) 280 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/2635822624,v1:172.21.15.62:6803/2635822624]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-22T19:16:04.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:04 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:16:03.035590+0000 mon.a (mon.0) 281 : cluster [DBG] osdmap e66: 8 total, 7 up, 8 in 2024-02-22T19:16:04.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:04 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:03.036659+0000 mon.a (mon.0) 282 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/2635822624,v1:172.21.15.62:6803/2635822624]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-22T19:16:04.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:04 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:03.276626+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:16:04.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:04 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:03.282590+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:16:04.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:04 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:03.287968+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:16:04.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:04 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:03.290192+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:16:04.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:04 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:03.291592+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:16:04.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:04 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:03.292543+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:16:04.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:04 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:03.293827+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-22T19:16:04.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:03.035523+0000 mon.a (mon.0) 280 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/2635822624,v1:172.21.15.62:6803/2635822624]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-22T19:16:04.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:16:03.035590+0000 mon.a (mon.0) 281 : cluster [DBG] osdmap e66: 8 total, 7 up, 8 in 2024-02-22T19:16:04.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:03.036659+0000 mon.a (mon.0) 282 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/2635822624,v1:172.21.15.62:6803/2635822624]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-22T19:16:04.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:03.276626+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:16:04.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:03.282590+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:16:04.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:03.287968+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:16:04.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:03.290192+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:16:04.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:03.291592+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:16:04.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:03.292543+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:16:04.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:03.293827+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-22T19:16:04.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:03.035523+0000 mon.a (mon.0) 280 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/2635822624,v1:172.21.15.62:6803/2635822624]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-22T19:16:04.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:16:03.035590+0000 mon.a (mon.0) 281 : cluster [DBG] osdmap e66: 8 total, 7 up, 8 in 2024-02-22T19:16:04.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:03.036659+0000 mon.a (mon.0) 282 : audit [INF] from='osd.0 [v2:172.21.15.62:6802/2635822624,v1:172.21.15.62:6803/2635822624]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-22T19:16:04.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:03.276626+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:16:04.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:03.282590+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:16:04.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:03.287968+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-22T19:16:04.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:03.290192+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:16:04.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:03.291592+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:16:04.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:03.292543+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:16:04.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:04 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:03.293827+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-22T19:16:05.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:05 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:03.293940+0000 mgr.y (mgr.24871) 81 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-22T19:16:05.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:05 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cephadm 2024-02-22T19:16:03.294570+0000 mgr.y (mgr.24871) 82 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-02-22T19:16:05.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:05 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:16:03.827915+0000 mgr.y (mgr.24871) 83 : cluster [DBG] pgmap v40: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 66/606 objects degraded (10.891%) 2024-02-22T19:16:05.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:05 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:16:04.030656+0000 mon.a (mon.0) 290 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-22T19:16:05.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:05 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:16:04.038686+0000 mon.a (mon.0) 291 : cluster [INF] osd.0 [v2:172.21.15.62:6802/2635822624,v1:172.21.15.62:6803/2635822624] boot 2024-02-22T19:16:05.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:05 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:16:04.038780+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-02-22T19:16:05.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:05 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:04.043857+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:16:05.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:05 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:16:05.037073+0000 mon.a (mon.0) 294 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-02-22T19:16:05.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:05 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:03.293940+0000 mgr.y (mgr.24871) 81 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-22T19:16:05.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:05 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cephadm 2024-02-22T19:16:03.294570+0000 mgr.y (mgr.24871) 82 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-02-22T19:16:05.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:05 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:16:03.827915+0000 mgr.y (mgr.24871) 83 : cluster [DBG] pgmap v40: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 66/606 objects degraded (10.891%) 2024-02-22T19:16:05.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:05 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:16:04.030656+0000 mon.a (mon.0) 290 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-22T19:16:05.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:05 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:16:04.038686+0000 mon.a (mon.0) 291 : cluster [INF] osd.0 [v2:172.21.15.62:6802/2635822624,v1:172.21.15.62:6803/2635822624] boot 2024-02-22T19:16:05.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:05 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:16:04.038780+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-02-22T19:16:05.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:05 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:04.043857+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:16:05.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:05 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:16:05.037073+0000 mon.a (mon.0) 294 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-02-22T19:16:05.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:05 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:03.293940+0000 mgr.y (mgr.24871) 81 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-22T19:16:05.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:05 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cephadm 2024-02-22T19:16:03.294570+0000 mgr.y (mgr.24871) 82 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-02-22T19:16:05.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:05 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:16:03.827915+0000 mgr.y (mgr.24871) 83 : cluster [DBG] pgmap v40: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 66/606 objects degraded (10.891%) 2024-02-22T19:16:05.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:05 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:16:04.030656+0000 mon.a (mon.0) 290 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-22T19:16:05.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:05 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:16:04.038686+0000 mon.a (mon.0) 291 : cluster [INF] osd.0 [v2:172.21.15.62:6802/2635822624,v1:172.21.15.62:6803/2635822624] boot 2024-02-22T19:16:05.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:05 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:16:04.038780+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2024-02-22T19:16:05.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:05 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:04.043857+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-22T19:16:05.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:05 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:16:05.037073+0000 mon.a (mon.0) 294 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2024-02-22T19:16:07.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:07 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:16:05.828490+0000 mgr.y (mgr.24871) 84 : cluster [DBG] pgmap v43: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 66/606 objects degraded (10.891%) 2024-02-22T19:16:07.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:07 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:16:05.828490+0000 mgr.y (mgr.24871) 84 : cluster [DBG] pgmap v43: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 66/606 objects degraded (10.891%) 2024-02-22T19:16:07.484 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:07 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:16:05.828490+0000 mgr.y (mgr.24871) 84 : cluster [DBG] pgmap v43: 129 pgs: 20 active+undersized+degraded, 29 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 66/606 objects degraded (10.891%) 2024-02-22T19:16:08.206 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:08 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:16:08.064671+0000 mon.a (mon.0) 295 : cluster [WRN] Health check update: Degraded data redundancy: 29/606 objects degraded (4.785%), 8 pgs degraded (PG_DEGRADED) 2024-02-22T19:16:08.207 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:08 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:16:08.064671+0000 mon.a (mon.0) 295 : cluster [WRN] Health check update: Degraded data redundancy: 29/606 objects degraded (4.785%), 8 pgs degraded (PG_DEGRADED) 2024-02-22T19:16:08.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:08 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:16:08.064671+0000 mon.a (mon.0) 295 : cluster [WRN] Health check update: Degraded data redundancy: 29/606 objects degraded (4.785%), 8 pgs degraded (PG_DEGRADED) 2024-02-22T19:16:08.502 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph orch ps' 2024-02-22T19:16:09.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:09 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:16:07.829326+0000 mgr.y (mgr.24871) 85 : cluster [DBG] pgmap v44: 129 pgs: 8 active+undersized+degraded, 8 active+undersized, 113 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 29/606 objects degraded (4.785%) 2024-02-22T19:16:09.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:09 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:16:07.829326+0000 mgr.y (mgr.24871) 85 : cluster [DBG] pgmap v44: 129 pgs: 8 active+undersized+degraded, 8 active+undersized, 113 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 29/606 objects degraded (4.785%) 2024-02-22T19:16:09.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:09 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:16:07.829326+0000 mgr.y (mgr.24871) 85 : cluster [DBG] pgmap v44: 129 pgs: 8 active+undersized+degraded, 8 active+undersized, 113 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 29/606 objects degraded (4.785%) 2024-02-22T19:16:10.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:10 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:16:10.118669+0000 mon.a (mon.0) 296 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/606 objects degraded (4.785%), 8 pgs degraded) 2024-02-22T19:16:10.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:10 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:16:10.118697+0000 mon.a (mon.0) 297 : cluster [INF] Cluster is now healthy 2024-02-22T19:16:10.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:10 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:16:10.118669+0000 mon.a (mon.0) 296 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/606 objects degraded (4.785%), 8 pgs degraded) 2024-02-22T19:16:10.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:10 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:16:10.118697+0000 mon.a (mon.0) 297 : cluster [INF] Cluster is now healthy 2024-02-22T19:16:10.484 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:10 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:16:10.118669+0000 mon.a (mon.0) 296 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/606 objects degraded (4.785%), 8 pgs degraded) 2024-02-22T19:16:10.484 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:10 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:16:10.118697+0000 mon.a (mon.0) 297 : cluster [INF] Cluster is now healthy 2024-02-22T19:16:10.531 INFO:teuthology.orchestra.run.smithi062.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-22T19:16:10.531 INFO:teuthology.orchestra.run.smithi062.stdout:alertmanager.a smithi062 running (2m) 7s ago 8m 17.2M - 0.26.0 9f27df16978d 61d969d05cbc 2024-02-22T19:16:10.531 INFO:teuthology.orchestra.run.smithi062.stdout:grafana.a smithi063 running (7m) 41s ago 7m 35.9M - 6.6.2 87a51ecf0b1c 9863e2980fa6 2024-02-22T19:16:10.532 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.x smithi063 *:8443 running (99s) 41s ago 11m 382M - 16.2.14-550-geb66ed92 7403d1862307 6d5a1e303e09 2024-02-22T19:16:10.532 INFO:teuthology.orchestra.run.smithi062.stdout:mgr.y smithi062 *:8443 running (2m) 7s ago 13m 419M - 16.2.14-550-geb66ed92 7403d1862307 0310c48cbf40 2024-02-22T19:16:10.532 INFO:teuthology.orchestra.run.smithi062.stdout:mon.a smithi062 running (88s) 7s ago 13m 39.9M 2048M 16.2.14-550-geb66ed92 7403d1862307 6a53ef7a2bff 2024-02-22T19:16:10.532 INFO:teuthology.orchestra.run.smithi062.stdout:mon.b smithi063 running (48s) 41s ago 11m 20.2M 2048M 16.2.14-550-geb66ed92 7403d1862307 feaf82947040 2024-02-22T19:16:10.532 INFO:teuthology.orchestra.run.smithi062.stdout:mon.c smithi062 running (57s) 7s ago 11m 33.3M 2048M 16.2.14-550-geb66ed92 7403d1862307 bef7fc155815 2024-02-22T19:16:10.532 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.a smithi062 running (8m) 7s ago 8m 13.3M - 1.7.0 72c9c2088986 3e27c560bf7f 2024-02-22T19:16:10.532 INFO:teuthology.orchestra.run.smithi062.stdout:node-exporter.b smithi063 running (8m) 41s ago 8m 13.7M - 1.7.0 72c9c2088986 ab2867e3fd57 2024-02-22T19:16:10.532 INFO:teuthology.orchestra.run.smithi062.stdout:osd.0 smithi062 running (11s) 7s ago 11m 13.4M 4096M 16.2.14-550-geb66ed92 7403d1862307 f27f0b6a9863 2024-02-22T19:16:10.532 INFO:teuthology.orchestra.run.smithi062.stdout:osd.1 smithi062 running (10m) 7s ago 10m 47.5M 4096M 15.2.0 204a01f9b0b6 d7a667155c4b 2024-02-22T19:16:10.532 INFO:teuthology.orchestra.run.smithi062.stdout:osd.2 smithi062 running (10m) 7s ago 10m 41.4M 4096M 15.2.0 204a01f9b0b6 dc5ec198f96d 2024-02-22T19:16:10.532 INFO:teuthology.orchestra.run.smithi062.stdout:osd.3 smithi062 running (10m) 7s ago 10m 43.7M 4096M 15.2.0 204a01f9b0b6 efb44063d52f 2024-02-22T19:16:10.532 INFO:teuthology.orchestra.run.smithi062.stdout:osd.4 smithi063 running (9m) 41s ago 9m 44.6M 4096M 15.2.0 204a01f9b0b6 0affbe803c22 2024-02-22T19:16:10.532 INFO:teuthology.orchestra.run.smithi062.stdout:osd.5 smithi063 running (9m) 41s ago 9m 43.0M 4096M 15.2.0 204a01f9b0b6 636665ed6108 2024-02-22T19:16:10.532 INFO:teuthology.orchestra.run.smithi062.stdout:osd.6 smithi063 running (9m) 41s ago 9m 42.3M 4096M 15.2.0 204a01f9b0b6 8c48e05bc7dd 2024-02-22T19:16:10.532 INFO:teuthology.orchestra.run.smithi062.stdout:osd.7 smithi063 running (8m) 41s ago 8m 45.0M 4096M 15.2.0 204a01f9b0b6 c298ad18c8bb 2024-02-22T19:16:10.533 INFO:teuthology.orchestra.run.smithi062.stdout:prometheus.a smithi063 running (2m) 41s ago 8m 36.2M - 2.50.0 38c53d8da784 564ec2e44075 2024-02-22T19:16:10.533 INFO:teuthology.orchestra.run.smithi062.stdout:rgw.r.z.smithi062.zxmpna smithi062 running (6m) 7s ago 6m 35.0M - 15.2.0 204a01f9b0b6 45553891c2c4 2024-02-22T19:16:10.533 INFO:teuthology.orchestra.run.smithi062.stdout:rgw.r.z.smithi063.feyald smithi063 running (6m) 41s ago 6m 33.2M - 15.2.0 204a01f9b0b6 478364f15ee3 2024-02-22T19:16:11.189 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph versions' 2024-02-22T19:16:11.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:11 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:16:09.829984+0000 mgr.y (mgr.24871) 86 : cluster [DBG] pgmap v45: 129 pgs: 129 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail 2024-02-22T19:16:11.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:11 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:10.522059+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:16:11.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:11 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:10.522413+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:16:11.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:11 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:10.522702+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:11 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:10.523010+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:11 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:10.523293+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:11 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:10.523585+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:11 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:10.525230+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:16:11.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:11 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:10.525513+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:11 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:10.525822+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:11 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:10.526110+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.464 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:11 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:10.526381+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:16:09.829984+0000 mgr.y (mgr.24871) 86 : cluster [DBG] pgmap v45: 129 pgs: 129 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail 2024-02-22T19:16:11.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:10.522059+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:16:11.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:10.522413+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:16:11.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:10.522702+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:10.523010+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:10.523293+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:10.523585+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:10.525230+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:16:11.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:10.525513+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:10.525822+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:10.526110+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:10.526381+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:16:09.829984+0000 mgr.y (mgr.24871) 86 : cluster [DBG] pgmap v45: 129 pgs: 129 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail 2024-02-22T19:16:11.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:10.522059+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-22T19:16:11.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:10.522413+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-22T19:16:11.485 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:10.522702+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:10.523010+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:10.523293+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:10.523585+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:10.525230+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-22T19:16:11.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:10.525513+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:10.525822+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:10.526110+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:11.486 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:11 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:10.526381+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-22T19:16:12.458 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:12 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:10.520159+0000 mgr.y (mgr.24871) 87 : audit [DBG] from='client.54109 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:16:12.458 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:12 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:10.520159+0000 mgr.y (mgr.24871) 87 : audit [DBG] from='client.54109 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:16:12.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:12 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:10.520159+0000 mgr.y (mgr.24871) 87 : audit [DBG] from='client.54109 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-22T19:16:13.224 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-22T19:16:13.224 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": { 2024-02-22T19:16:13.224 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 3 2024-02-22T19:16:13.224 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:16:13.224 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": { 2024-02-22T19:16:13.225 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 2 2024-02-22T19:16:13.225 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:16:13.225 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": { 2024-02-22T19:16:13.225 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 7, 2024-02-22T19:16:13.225 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 1 2024-02-22T19:16:13.225 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:16:13.225 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": {}, 2024-02-22T19:16:13.225 INFO:teuthology.orchestra.run.smithi062.stdout: "rgw": { 2024-02-22T19:16:13.225 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-22T19:16:13.225 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-02-22T19:16:13.226 INFO:teuthology.orchestra.run.smithi062.stdout: "overall": { 2024-02-22T19:16:13.226 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 9, 2024-02-22T19:16:13.226 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph version 16.2.14-550-geb66ed92 (eb66ed921e744301e6863be6353618d63967ea59) pacific (stable)": 6 2024-02-22T19:16:13.226 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-02-22T19:16:13.226 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-22T19:16:13.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:13 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:16:11.830530+0000 mgr.y (mgr.24871) 88 : cluster [DBG] pgmap v46: 129 pgs: 129 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail 2024-02-22T19:16:13.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:16:11.830530+0000 mgr.y (mgr.24871) 88 : cluster [DBG] pgmap v46: 129 pgs: 129 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail 2024-02-22T19:16:13.484 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:13 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:16:11.830530+0000 mgr.y (mgr.24871) 88 : cluster [DBG] pgmap v46: 129 pgs: 129 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail 2024-02-22T19:16:13.894 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-02-22T19:16:14.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:14 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:13.223626+0000 mon.a (mon.0) 309 : audit [DBG] from='client.54115 172.21.15.62:0/391109438' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:16:14.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:13.223626+0000 mon.a (mon.0) 309 : audit [DBG] from='client.54115 172.21.15.62:0/391109438' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:16:14.484 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:14 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:13.223626+0000 mon.a (mon.0) 309 : audit [DBG] from='client.54115 172.21.15.62:0/391109438' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:16:15.417 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:15 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:16:13.830979+0000 mgr.y (mgr.24871) 89 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail 2024-02-22T19:16:15.417 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:15 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:16:13.830979+0000 mgr.y (mgr.24871) 89 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail 2024-02-22T19:16:15.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:15 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:16:13.830979+0000 mgr.y (mgr.24871) 89 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail 2024-02-22T19:16:15.956 INFO:teuthology.orchestra.run.smithi062.stdout:false 2024-02-22T19:16:16.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:16 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:15.944772+0000 mon.c (mon.1) 3 : audit [DBG] from='client.44157 172.21.15.62:0/1976084873' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:16:16.234 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:16 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: audit 2024-02-22T19:16:16.047436+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:16:16.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:16 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:15.944772+0000 mon.c (mon.1) 3 : audit [DBG] from='client.44157 172.21.15.62:0/1976084873' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:16:16.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:16 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: audit 2024-02-22T19:16:16.047436+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:16:16.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:16 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:15.944772+0000 mon.c (mon.1) 3 : audit [DBG] from='client.44157 172.21.15.62:0/1976084873' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-22T19:16:16.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:16 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: audit 2024-02-22T19:16:16.047436+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.24871 172.21.15.62:0/193784368' entity='mgr.y' 2024-02-22T19:16:16.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-22T19:16:16.624 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_kamoltat_ceph_391ea41edcaa85aa674d6e816fb2469974fc7d8e/qa/tasks/cephadm.py", line 1058, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/github.com_kamoltat_ceph_391ea41edcaa85aa674d6e816fb2469974fc7d8e/qa/tasks/cephadm.py", line 34, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi062 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2024-02-22T19:16:16.833 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=741c886549ef411c928e8e23896d9112 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_kamoltat_ceph_391ea41edcaa85aa674d6e816fb2469974fc7d8e/qa/tasks/cephadm.py", line 1058, in shell _shell(ctx, cluster_name, remote, File "/home/teuthworker/src/github.com_kamoltat_ceph_391ea41edcaa85aa674d6e816fb2469974fc7d8e/qa/tasks/cephadm.py", line 34, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi062 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2024-02-22T19:16:16.895 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-22T19:16:16.904 INFO:tasks.cephadm:Teardown begin 2024-02-22T19:16:16.904 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-22T19:16:16.942 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-22T19:16:16.984 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-22T19:16:16.984 DEBUG:teuthology.orchestra.run.smithi062:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-22T19:16:17.004 DEBUG:teuthology.orchestra.run.smithi063:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-22T19:16:17.046 INFO:tasks.cephadm:Stopping all daemons... 2024-02-22T19:16:17.046 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-02-22T19:16:17.046 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.a 2024-02-22T19:16:17.193 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:17 smithi062 systemd[1]: Stopping Ceph mon.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:16:17.193 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:17 smithi062 bash[94970]: Error: no container with name or ID "ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon.a" found: no such container 2024-02-22T19:16:17.463 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:17 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: cluster 2024-02-22T19:16:15.831298+0000 mgr.y (mgr.24871) 90 : cluster [DBG] pgmap v48: 129 pgs: 129 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail 2024-02-22T19:16:17.484 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:17 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: cluster 2024-02-22T19:16:15.831298+0000 mgr.y (mgr.24871) 90 : cluster [DBG] pgmap v48: 129 pgs: 129 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail 2024-02-22T19:16:17.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:17 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: cluster 2024-02-22T19:16:15.831298+0000 mgr.y (mgr.24871) 90 : cluster [DBG] pgmap v48: 129 pgs: 129 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail 2024-02-22T19:16:17.484 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:17 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:16:17.354+0000 7f31985d8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-22T19:16:17.485 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:17 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a[89300]: debug 2024-02-22T19:16:17.354+0000 7f31985d8700 -1 mon.a@0(leader) e4 *** Got Signal Terminated *** 2024-02-22T19:16:17.984 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 22 19:16:17 smithi062 bash[95009]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-a 2024-02-22T19:16:18.177 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.a.service' 2024-02-22T19:16:18.233 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:16:18.233 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-02-22T19:16:18.233 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-02-22T19:16:18.234 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.c 2024-02-22T19:16:18.484 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:18 smithi062 systemd[1]: Stopping Ceph mon.c for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:16:18.484 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:18 smithi062 bash[95128]: Error: no container with name or ID "ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon.c" found: no such container 2024-02-22T19:16:18.866 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:18 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:16:18.591+0000 7efd7e2ee700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-22T19:16:18.866 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:18 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c[91302]: debug 2024-02-22T19:16:18.591+0000 7efd7e2ee700 -1 mon.c@1(peon) e4 *** Got Signal Terminated *** 2024-02-22T19:16:19.484 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 22 19:16:19 smithi062 bash[95171]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-c 2024-02-22T19:16:19.883 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.c.service' 2024-02-22T19:16:19.926 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:16:19.926 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-02-22T19:16:19.927 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-02-22T19:16:19.927 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.b 2024-02-22T19:16:20.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:19 smithi063 systemd[1]: Stopping Ceph mon.b for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:16:20.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:19 smithi063 bash[55713]: Error: no container with name or ID "ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon.b" found: no such container 2024-02-22T19:16:20.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:20 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:16:20.379+0000 7f4d047b4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-22T19:16:20.713 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:20 smithi063 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b[54234]: debug 2024-02-22T19:16:20.379+0000 7f4d047b4700 -1 mon.b@2(peon) e4 *** Got Signal Terminated *** 2024-02-22T19:16:21.213 INFO:journalctl@ceph.mon.b.smithi063.stdout:Feb 22 19:16:20 smithi063 bash[55753]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mon-b 2024-02-22T19:16:21.264 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mon.b.service' 2024-02-22T19:16:21.328 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:16:21.328 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-02-22T19:16:21.328 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-02-22T19:16:21.329 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mgr.y 2024-02-22T19:16:21.656 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:16:21 smithi062 systemd[1]: Stopping Ceph mgr.y for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:16:21.656 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:16:21 smithi062 bash[95381]: Error: no container with name or ID "ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr.y" found: no such container 2024-02-22T19:16:21.920 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:16:21 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y[87229]: debug 2024-02-22T19:16:21.653+0000 7f84a1432700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-22T19:16:22.234 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 22 19:16:22 smithi062 bash[95421]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-y 2024-02-22T19:16:22.453 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mgr.y.service' 2024-02-22T19:16:22.492 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:16:22.493 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-02-22T19:16:22.493 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-02-22T19:16:22.493 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mgr.x 2024-02-22T19:16:22.964 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:16:22 smithi063 systemd[1]: Stopping Ceph mgr.x for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:16:22.964 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:16:22 smithi063 bash[55872]: Error: no container with name or ID "ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr.x" found: no such container 2024-02-22T19:16:23.463 INFO:journalctl@ceph.mgr.x.smithi063.stdout:Feb 22 19:16:23 smithi063 bash[55913]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-mgr-x 2024-02-22T19:16:23.677 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@mgr.x.service' 2024-02-22T19:16:23.715 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:16:23.716 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-02-22T19:16:23.716 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-22T19:16:23.716 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.0 2024-02-22T19:16:24.167 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:16:23 smithi062 systemd[1]: Stopping Ceph osd.0 for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:16:24.168 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:16:23 smithi062 bash[95543]: Error: no container with name or ID "ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-osd.0" found: no such container 2024-02-22T19:16:24.484 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:16:24 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-osd-0[93603]: debug 2024-02-22T19:16:24.165+0000 7f6ab19b9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-22T19:16:24.484 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:16:24 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-osd-0[93603]: debug 2024-02-22T19:16:24.165+0000 7f6ab19b9700 -1 osd.0 68 *** Got signal Terminated *** 2024-02-22T19:16:24.484 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:16:24 smithi062 ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-osd-0[93603]: debug 2024-02-22T19:16:24.165+0000 7f6ab19b9700 -1 osd.0 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T19:16:29.984 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 22 19:16:29 smithi062 bash[95582]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-osd-0 2024-02-22T19:16:31.376 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.0.service' 2024-02-22T19:16:31.422 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:16:31.422 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-22T19:16:31.422 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-22T19:16:31.422 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.1 2024-02-22T19:16:31.634 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 22 19:16:31 smithi062 systemd[1]: Stopping Ceph osd.1 for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:16:31.635 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 22 19:16:31 smithi062 bash[71255]: debug 2024-02-22T19:16:31.584+0000 7f411a4f1700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:16:31.635 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 22 19:16:31 smithi062 bash[71255]: debug 2024-02-22T19:16:31.584+0000 7f411a4f1700 -1 osd.1 68 *** Got signal Terminated *** 2024-02-22T19:16:31.635 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 22 19:16:31 smithi062 bash[71255]: debug 2024-02-22T19:16:31.584+0000 7f411a4f1700 -1 osd.1 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T19:16:32.234 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 22 19:16:32 smithi062 bash[95819]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-osd.1 2024-02-22T19:16:32.244 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 22 19:16:32 smithi062 bash[95867]: bash: /var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/osd.1/unit.stop: No such file or directory 2024-02-22T19:16:33.860 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.1.service' 2024-02-22T19:16:33.903 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:16:33.903 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-22T19:16:33.903 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-22T19:16:33.903 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.2 2024-02-22T19:16:34.234 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 22 19:16:33 smithi062 systemd[1]: Stopping Ceph osd.2 for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:16:34.234 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 22 19:16:34 smithi062 bash[72877]: debug 2024-02-22T19:16:34.088+0000 7fe8a5edf700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:16:34.234 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 22 19:16:34 smithi062 bash[72877]: debug 2024-02-22T19:16:34.088+0000 7fe8a5edf700 -1 osd.2 68 *** Got signal Terminated *** 2024-02-22T19:16:34.235 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 22 19:16:34 smithi062 bash[72877]: debug 2024-02-22T19:16:34.088+0000 7fe8a5edf700 -1 osd.2 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T19:16:34.734 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 22 19:16:34 smithi062 bash[95987]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-osd.2 2024-02-22T19:16:34.734 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 22 19:16:34 smithi062 bash[96028]: bash: /var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/osd.2/unit.stop: No such file or directory 2024-02-22T19:16:36.005 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.2.service' 2024-02-22T19:16:36.048 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:16:36.048 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-22T19:16:36.048 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-22T19:16:36.048 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.3 2024-02-22T19:16:36.293 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 22 19:16:36 smithi062 systemd[1]: Stopping Ceph osd.3 for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:16:36.293 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 22 19:16:36 smithi062 bash[74469]: debug 2024-02-22T19:16:36.225+0000 7f0be77d1700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:16:36.293 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 22 19:16:36 smithi062 bash[74469]: debug 2024-02-22T19:16:36.225+0000 7f0be77d1700 -1 osd.3 68 *** Got signal Terminated *** 2024-02-22T19:16:36.293 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 22 19:16:36 smithi062 bash[74469]: debug 2024-02-22T19:16:36.225+0000 7f0be77d1700 -1 osd.3 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T19:16:36.952 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 22 19:16:36 smithi062 bash[96148]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-osd.3 2024-02-22T19:16:36.952 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 22 19:16:36 smithi062 bash[96192]: bash: /var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/osd.3/unit.stop: No such file or directory 2024-02-22T19:16:38.040 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.3.service' 2024-02-22T19:16:38.080 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:16:38.080 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-22T19:16:38.080 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-22T19:16:38.080 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.4 2024-02-22T19:16:38.463 INFO:journalctl@ceph.osd.4.smithi063.stdout:Feb 22 19:16:38 smithi063 systemd[1]: Stopping Ceph osd.4 for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:16:38.464 INFO:journalctl@ceph.osd.4.smithi063.stdout:Feb 22 19:16:38 smithi063 bash[37857]: debug 2024-02-22T19:16:38.235+0000 7f0f9526b700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:16:38.464 INFO:journalctl@ceph.osd.4.smithi063.stdout:Feb 22 19:16:38 smithi063 bash[37857]: debug 2024-02-22T19:16:38.235+0000 7f0f9526b700 -1 osd.4 68 *** Got signal Terminated *** 2024-02-22T19:16:38.464 INFO:journalctl@ceph.osd.4.smithi063.stdout:Feb 22 19:16:38 smithi063 bash[37857]: debug 2024-02-22T19:16:38.235+0000 7f0f9526b700 -1 osd.4 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T19:16:38.963 INFO:journalctl@ceph.osd.4.smithi063.stdout:Feb 22 19:16:38 smithi063 bash[56038]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-osd.4 2024-02-22T19:16:38.964 INFO:journalctl@ceph.osd.4.smithi063.stdout:Feb 22 19:16:38 smithi063 bash[56077]: bash: /var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/osd.4/unit.stop: No such file or directory 2024-02-22T19:16:40.050 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.4.service' 2024-02-22T19:16:40.094 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:16:40.094 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-22T19:16:40.094 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-22T19:16:40.095 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.5 2024-02-22T19:16:40.318 INFO:journalctl@ceph.osd.5.smithi063.stdout:Feb 22 19:16:40 smithi063 systemd[1]: Stopping Ceph osd.5 for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:16:40.318 INFO:journalctl@ceph.osd.5.smithi063.stdout:Feb 22 19:16:40 smithi063 bash[39339]: debug 2024-02-22T19:16:40.278+0000 7f8e9f5e3700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:16:40.318 INFO:journalctl@ceph.osd.5.smithi063.stdout:Feb 22 19:16:40 smithi063 bash[39339]: debug 2024-02-22T19:16:40.278+0000 7f8e9f5e3700 -1 osd.5 68 *** Got signal Terminated *** 2024-02-22T19:16:40.318 INFO:journalctl@ceph.osd.5.smithi063.stdout:Feb 22 19:16:40 smithi063 bash[39339]: debug 2024-02-22T19:16:40.278+0000 7f8e9f5e3700 -1 osd.5 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T19:16:40.963 INFO:journalctl@ceph.osd.5.smithi063.stdout:Feb 22 19:16:40 smithi063 bash[56194]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-osd.5 2024-02-22T19:16:40.963 INFO:journalctl@ceph.osd.5.smithi063.stdout:Feb 22 19:16:40 smithi063 bash[56233]: bash: /var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/osd.5/unit.stop: No such file or directory 2024-02-22T19:16:42.194 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.5.service' 2024-02-22T19:16:42.236 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:16:42.236 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-22T19:16:42.237 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-02-22T19:16:42.237 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.6 2024-02-22T19:16:42.463 INFO:journalctl@ceph.osd.6.smithi063.stdout:Feb 22 19:16:42 smithi063 systemd[1]: Stopping Ceph osd.6 for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:16:42.464 INFO:journalctl@ceph.osd.6.smithi063.stdout:Feb 22 19:16:42 smithi063 bash[40821]: debug 2024-02-22T19:16:42.413+0000 7fb67f732700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:16:42.464 INFO:journalctl@ceph.osd.6.smithi063.stdout:Feb 22 19:16:42 smithi063 bash[40821]: debug 2024-02-22T19:16:42.413+0000 7fb67f732700 -1 osd.6 68 *** Got signal Terminated *** 2024-02-22T19:16:42.464 INFO:journalctl@ceph.osd.6.smithi063.stdout:Feb 22 19:16:42 smithi063 bash[40821]: debug 2024-02-22T19:16:42.413+0000 7fb67f732700 -1 osd.6 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T19:16:43.213 INFO:journalctl@ceph.osd.6.smithi063.stdout:Feb 22 19:16:42 smithi063 bash[56352]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-osd.6 2024-02-22T19:16:43.214 INFO:journalctl@ceph.osd.6.smithi063.stdout:Feb 22 19:16:42 smithi063 bash[56391]: bash: /var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/osd.6/unit.stop: No such file or directory 2024-02-22T19:16:44.244 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.6.service' 2024-02-22T19:16:44.286 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:16:44.286 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-02-22T19:16:44.286 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-02-22T19:16:44.286 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.7 2024-02-22T19:16:44.509 INFO:journalctl@ceph.osd.7.smithi063.stdout:Feb 22 19:16:44 smithi063 systemd[1]: Stopping Ceph osd.7 for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:16:44.509 INFO:journalctl@ceph.osd.7.smithi063.stdout:Feb 22 19:16:44 smithi063 bash[42392]: debug 2024-02-22T19:16:44.465+0000 7f23b3dd0700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-22T19:16:44.509 INFO:journalctl@ceph.osd.7.smithi063.stdout:Feb 22 19:16:44 smithi063 bash[42392]: debug 2024-02-22T19:16:44.465+0000 7f23b3dd0700 -1 osd.7 68 *** Got signal Terminated *** 2024-02-22T19:16:44.509 INFO:journalctl@ceph.osd.7.smithi063.stdout:Feb 22 19:16:44 smithi063 bash[42392]: debug 2024-02-22T19:16:44.465+0000 7f23b3dd0700 -1 osd.7 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-22T19:16:45.041 INFO:journalctl@ceph.osd.7.smithi063.stdout:Feb 22 19:16:44 smithi063 bash[56510]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-osd.7 2024-02-22T19:16:45.041 INFO:journalctl@ceph.osd.7.smithi063.stdout:Feb 22 19:16:44 smithi063 bash[56553]: bash: /var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/osd.7/unit.stop: No such file or directory 2024-02-22T19:16:46.263 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@osd.7.service' 2024-02-22T19:16:46.303 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:16:46.303 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-02-22T19:16:46.304 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-02-22T19:16:46.304 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@prometheus.a 2024-02-22T19:16:46.463 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:16:46 smithi063 systemd[1]: Stopping Ceph prometheus.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:16:46.781 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:16:46 smithi063 bash[50123]: ts=2024-02-22T19:16:46.492Z caller=main.go:953 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-02-22T19:16:46.782 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:16:46 smithi063 bash[50123]: ts=2024-02-22T19:16:46.492Z caller=main.go:977 level=info msg="Stopping scrape discovery manager..." 2024-02-22T19:16:46.782 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:16:46 smithi063 bash[50123]: ts=2024-02-22T19:16:46.493Z caller=main.go:991 level=info msg="Stopping notify discovery manager..." 2024-02-22T19:16:46.782 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:16:46 smithi063 bash[50123]: ts=2024-02-22T19:16:46.493Z caller=manager.go:160 level=info component="rule manager" msg="Stopping rule manager..." 2024-02-22T19:16:46.782 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:16:46 smithi063 bash[50123]: ts=2024-02-22T19:16:46.493Z caller=main.go:973 level=info msg="Scrape discovery manager stopped" 2024-02-22T19:16:46.782 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:16:46 smithi063 bash[50123]: ts=2024-02-22T19:16:46.493Z caller=main.go:987 level=info msg="Notify discovery manager stopped" 2024-02-22T19:16:46.783 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:16:46 smithi063 bash[50123]: ts=2024-02-22T19:16:46.493Z caller=manager.go:170 level=info component="rule manager" msg="Rule manager stopped" 2024-02-22T19:16:46.783 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:16:46 smithi063 bash[50123]: ts=2024-02-22T19:16:46.493Z caller=main.go:1028 level=info msg="Stopping scrape manager..." 2024-02-22T19:16:46.783 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:16:46 smithi063 bash[50123]: ts=2024-02-22T19:16:46.493Z caller=main.go:1020 level=info msg="Scrape manager stopped" 2024-02-22T19:16:46.783 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:16:46 smithi063 bash[50123]: ts=2024-02-22T19:16:46.494Z caller=notifier.go:604 level=info component=notifier msg="Stopping notification manager..." 2024-02-22T19:16:46.783 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:16:46 smithi063 bash[50123]: ts=2024-02-22T19:16:46.494Z caller=main.go:1250 level=info msg="Notifier manager stopped" 2024-02-22T19:16:46.783 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:16:46 smithi063 bash[50123]: ts=2024-02-22T19:16:46.494Z caller=main.go:1262 level=info msg="See you next time!" 2024-02-22T19:16:47.213 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:16:46 smithi063 bash[56671]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-prometheus.a 2024-02-22T19:16:47.214 INFO:journalctl@ceph.prometheus.a.smithi063.stdout:Feb 22 19:16:46 smithi063 bash[56710]: bash: /var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/prometheus.a/unit.stop: No such file or directory 2024-02-22T19:16:47.237 DEBUG:teuthology.orchestra.run.smithi063:> sudo pkill -f 'journalctl -f -n 0 -u ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@prometheus.a.service' 2024-02-22T19:16:47.276 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-22T19:16:47.276 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-02-22T19:16:47.277 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 --force --keep-logs 2024-02-22T19:16:47.415 INFO:teuthology.orchestra.run.smithi062.stderr:usage: cephadm [-h] [--image IMAGE] [--docker] [--data-dir DATA_DIR] 2024-02-22T19:16:47.415 INFO:teuthology.orchestra.run.smithi062.stderr: [--log-dir LOG_DIR] [--logrotate-dir LOGROTATE_DIR] 2024-02-22T19:16:47.416 INFO:teuthology.orchestra.run.smithi062.stderr: [--unit-dir UNIT_DIR] [--verbose] [--timeout TIMEOUT] 2024-02-22T19:16:47.416 INFO:teuthology.orchestra.run.smithi062.stderr: [--retry RETRY] 2024-02-22T19:16:47.416 INFO:teuthology.orchestra.run.smithi062.stderr: {version,pull,inspect-image,ls,list-networks,adopt,rm-daemon,rm-cluster,run,shell,enter,ceph-volume,unit,logs,bootstrap,deploy,check-host,prepare-host,add-repo,rm-repo,install} 2024-02-22T19:16:47.416 INFO:teuthology.orchestra.run.smithi062.stderr: ... 2024-02-22T19:16:47.416 INFO:teuthology.orchestra.run.smithi062.stderr:cephadm: error: unrecognized arguments: --keep-logs 2024-02-22T19:16:47.425 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-22T19:16:47.426 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 --force --keep-logs 2024-02-22T19:16:47.552 INFO:teuthology.orchestra.run.smithi063.stderr:usage: cephadm [-h] [--image IMAGE] [--docker] [--data-dir DATA_DIR] 2024-02-22T19:16:47.609 INFO:teuthology.orchestra.run.smithi063.stderr: [--log-dir LOG_DIR] [--logrotate-dir LOGROTATE_DIR] 2024-02-22T19:16:47.610 INFO:teuthology.orchestra.run.smithi063.stderr: [--unit-dir UNIT_DIR] [--verbose] [--timeout TIMEOUT] 2024-02-22T19:16:47.610 INFO:teuthology.orchestra.run.smithi063.stderr: [--retry RETRY] 2024-02-22T19:16:47.610 INFO:teuthology.orchestra.run.smithi063.stderr: {version,pull,inspect-image,ls,list-networks,adopt,rm-daemon,rm-cluster,run,shell,enter,ceph-volume,unit,logs,bootstrap,deploy,check-host,prepare-host,add-repo,rm-repo,install} 2024-02-22T19:16:47.610 INFO:teuthology.orchestra.run.smithi063.stderr: ... 2024-02-22T19:16:47.610 INFO:teuthology.orchestra.run.smithi063.stderr:cephadm: error: unrecognized arguments: --keep-logs 2024-02-22T19:16:47.611 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-22T19:16:47.611 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-22T19:16:47.641 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-22T19:16:47.669 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-22T19:16:47.671 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570945/remote/ubuntu@smithi062.front.sepia.ceph.com/crash 2024-02-22T19:16:47.672 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/crash -- . 2024-02-22T19:16:47.721 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570945/remote/ubuntu@smithi063.front.sepia.ceph.com/crash 2024-02-22T19:16:47.722 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/crash -- . 2024-02-22T19:16:47.770 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-22T19:16:47.770 DEBUG:teuthology.orchestra.run.smithi062:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(PG_' | egrep -v 'mons down' | egrep -v 'pg inactive' | egrep -v 'out of quorum' | egrep -v '\(OSD_' | egrep -v 'osds down' | egrep -v 'osd down' | head -n 1 2024-02-22T19:16:47.801 INFO:tasks.cephadm:Compressing logs... 2024-02-22T19:16:47.802 DEBUG:teuthology.orchestra.run.smithi062:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-22T19:16:47.843 DEBUG:teuthology.orchestra.run.smithi063:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-22T19:16:47.869 INFO:teuthology.orchestra.run.smithi062.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-22T19:16:47.869 INFO:teuthology.orchestra.run.smithi062.stderr:: No such file or directory 2024-02-22T19:16:47.869 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-volume.log 2024-02-22T19:16:47.871 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.2.log 2024-02-22T19:16:47.871 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-mgr.y.log 2024-02-22T19:16:47.872 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-volume.log: /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph.audit.log 2024-02-22T19:16:47.872 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph.cephadm.log 2024-02-22T19:16:47.872 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph.audit.log: /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph.cephadm.log: 89.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-22T19:16:47.872 INFO:teuthology.orchestra.run.smithi062.stderr: 89.7% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph.cephadm.log.gz 2024-02-22T19:16:47.872 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.3.log 2024-02-22T19:16:47.872 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.0.log 2024-02-22T19:16:47.874 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-client.rgw.r.z.smithi062.zxmpna.log 2024-02-22T19:16:47.875 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-mon.a.log 2024-02-22T19:16:47.875 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-client.rgw.r.z.smithi062.zxmpna.log: 58.7% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-client.rgw.r.z.smithi062.zxmpna.log.gz 2024-02-22T19:16:47.875 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-mon.a.log: 91.4% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-volume.log.gz 2024-02-22T19:16:47.877 INFO:teuthology.orchestra.run.smithi063.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-02-22T19:16:47.877 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-22T19:16:47.877 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.6.log 2024-02-22T19:16:47.877 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-volume.log 2024-02-22T19:16:47.878 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph.audit.log 2024-02-22T19:16:47.878 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.6.log: /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph.cephadm.log 2024-02-22T19:16:47.878 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-client.rgw.r.z.smithi063.feyald.log 2024-02-22T19:16:47.878 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph.cephadm.log: /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-client.rgw.r.z.smithi063.feyald.log: 81.2% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph.cephadm.log.gz 2024-02-22T19:16:47.878 INFO:teuthology.orchestra.run.smithi063.stderr: 90.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-22T19:16:47.878 INFO:teuthology.orchestra.run.smithi063.stderr: 57.9% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-client.rgw.r.z.smithi063.feyald.log.gz 2024-02-22T19:16:47.878 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.7.log 2024-02-22T19:16:47.878 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-mgr.x.log 2024-02-22T19:16:47.879 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-mon.b.log 2024-02-22T19:16:47.879 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-mgr.x.log: /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-mon.b.log: 91.3% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-volume.log.gz 2024-02-22T19:16:47.882 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph.log 2024-02-22T19:16:47.883 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.4.log 2024-02-22T19:16:47.883 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-mon.c.log 2024-02-22T19:16:47.884 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph.log: /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.4.log: 87.3% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph.log.gz 2024-02-22T19:16:47.884 INFO:teuthology.orchestra.run.smithi063.stderr:gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.5.log 2024-02-22T19:16:47.885 INFO:teuthology.orchestra.run.smithi063.stderr:/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.5.log: 95.5% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph.audit.log.gz 2024-02-22T19:16:47.887 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph.log 2024-02-22T19:16:47.890 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph.log: 92.9% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph.log.gz 2024-02-22T19:16:47.894 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.1.log 2024-02-22T19:16:47.900 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.1.log: 96.4% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph.audit.log.gz 2024-02-22T19:16:47.901 INFO:teuthology.orchestra.run.smithi063.stderr: 90.0% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-mgr.x.log.gz 2024-02-22T19:16:48.069 INFO:teuthology.orchestra.run.smithi062.stderr: 91.7% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-mgr.y.log.gz 2024-02-22T19:16:48.096 INFO:teuthology.orchestra.run.smithi062.stderr: 92.8% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.2.log.gz 2024-02-22T19:16:48.180 INFO:teuthology.orchestra.run.smithi063.stderr: 92.7% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.6.log.gz 2024-02-22T19:16:48.187 INFO:teuthology.orchestra.run.smithi063.stderr: 93.5% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.7.log.gz 2024-02-22T19:16:48.236 INFO:teuthology.orchestra.run.smithi063.stderr: 93.8% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-mon.b.log.gz 2024-02-22T19:16:48.271 INFO:teuthology.orchestra.run.smithi062.stderr: 93.4% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.1.log.gz 2024-02-22T19:16:48.307 INFO:teuthology.orchestra.run.smithi062.stderr: 93.2% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.3.log.gz 2024-02-22T19:16:48.321 INFO:teuthology.orchestra.run.smithi063.stderr: 92.9% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.5.log.gz 2024-02-22T19:16:48.341 INFO:teuthology.orchestra.run.smithi062.stderr: 93.1% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.0.log.gz 2024-02-22T19:16:48.348 INFO:teuthology.orchestra.run.smithi062.stderr: 93.3% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-mon.c.log.gz 2024-02-22T19:16:48.353 INFO:teuthology.orchestra.run.smithi063.stderr: 93.2% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-osd.4.log.gz 2024-02-22T19:16:48.355 INFO:teuthology.orchestra.run.smithi063.stderr: 2024-02-22T19:16:48.355 INFO:teuthology.orchestra.run.smithi063.stderr:real 0m0.494s 2024-02-22T19:16:48.355 INFO:teuthology.orchestra.run.smithi063.stderr:user 0m1.873s 2024-02-22T19:16:48.356 INFO:teuthology.orchestra.run.smithi063.stderr:sys 0m0.089s 2024-02-22T19:16:48.639 INFO:teuthology.orchestra.run.smithi062.stderr: 91.1% -- replaced with /var/log/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/ceph-mon.a.log.gz 2024-02-22T19:16:48.642 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-22T19:16:48.642 INFO:teuthology.orchestra.run.smithi062.stderr:real 0m0.782s 2024-02-22T19:16:48.642 INFO:teuthology.orchestra.run.smithi062.stderr:user 0m2.889s 2024-02-22T19:16:48.642 INFO:teuthology.orchestra.run.smithi062.stderr:sys 0m0.109s 2024-02-22T19:16:48.642 INFO:tasks.cephadm:Archiving logs... 2024-02-22T19:16:48.642 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570945/remote/ubuntu@smithi062.front.sepia.ceph.com/log 2024-02-22T19:16:48.643 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-22T19:16:49.086 DEBUG:teuthology.misc:Transferring archived files from smithi063:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570945/remote/ubuntu@smithi063.front.sepia.ceph.com/log 2024-02-22T19:16:49.087 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-22T19:16:49.363 INFO:tasks.cephadm:Removing cluster... 2024-02-22T19:16:49.364 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 --force 2024-02-22T19:16:50.458 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:16:50 smithi062 systemd[1]: Stopping Ceph node-exporter.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:16:50.984 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:16:50 smithi062 bash[96687]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-node-exporter.a 2024-02-22T19:16:50.984 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:16:50 smithi062 bash[96724]: bash: /var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/node-exporter.a/unit.stop: No such file or directory 2024-02-22T19:16:51.484 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:16:51 smithi062 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=2/INVALIDARGUMENT 2024-02-22T19:16:51.484 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:16:51 smithi062 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-02-22T19:16:51.485 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 22 19:16:51 smithi062 systemd[1]: Stopped Ceph node-exporter.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:16:51.485 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:16:51 smithi062 systemd[1]: Stopping Ceph alertmanager.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:16:51.485 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:16:51 smithi062 bash[86519]: ts=2024-02-22T19:16:51.298Z caller=main.go:594 level=info msg="Received SIGTERM, exiting gracefully..." 2024-02-22T19:16:51.844 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:16:51 smithi062 bash[96759]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-alertmanager.a 2024-02-22T19:16:51.844 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:16:51 smithi062 bash[96799]: bash: /var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/alertmanager.a/unit.stop: No such file or directory 2024-02-22T19:16:51.845 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:16:51 smithi062 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@alertmanager.a.service: Succeeded. 2024-02-22T19:16:51.845 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 22 19:16:51 smithi062 systemd[1]: Stopped Ceph alertmanager.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:17:03.023 DEBUG:teuthology.orchestra.run.smithi063:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 --force 2024-02-22T19:17:04.204 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:17:04 smithi063 systemd[1]: Stopping Ceph node-exporter.b for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:17:04.726 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:17:04 smithi063 bash[57115]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-node-exporter.b 2024-02-22T19:17:04.727 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:17:04 smithi063 bash[57156]: bash: /var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/node-exporter.b/unit.stop: No such file or directory 2024-02-22T19:17:04.727 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:17:04 smithi063 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=2/INVALIDARGUMENT 2024-02-22T19:17:04.727 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:17:04 smithi063 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-02-22T19:17:04.727 INFO:journalctl@ceph.node-exporter.b.smithi063.stdout:Feb 22 19:17:04 smithi063 systemd[1]: Stopped Ceph node-exporter.b for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:17:04.981 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:17:04 smithi063 systemd[1]: Stopping Ceph grafana.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715... 2024-02-22T19:17:04.982 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:17:04 smithi063 bash[44872]: t=2024-02-22T19:17:04+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-02-22T19:17:04.982 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:17:04 smithi063 bash[44872]: t=2024-02-22T19:17:04+0000 lvl=info msg="Stopped CleanUpService" logger=server reason="context canceled" 2024-02-22T19:17:04.982 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:17:04 smithi063 bash[44872]: t=2024-02-22T19:17:04+0000 lvl=info msg="Stopped UserAuthTokenService" logger=server reason="context canceled" 2024-02-22T19:17:04.982 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:17:04 smithi063 bash[44872]: t=2024-02-22T19:17:04+0000 lvl=info msg="Stopped PluginManager" logger=server reason="context canceled" 2024-02-22T19:17:04.982 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:17:04 smithi063 bash[44872]: t=2024-02-22T19:17:04+0000 lvl=info msg="Stopped NotificationService" logger=server reason="context canceled" 2024-02-22T19:17:04.982 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:17:04 smithi063 bash[44872]: t=2024-02-22T19:17:04+0000 lvl=info msg="Stopped InternalMetricsService" logger=server reason="context canceled" 2024-02-22T19:17:04.982 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:17:04 smithi063 bash[44872]: t=2024-02-22T19:17:04+0000 lvl=info msg="Stopped Stream Manager" 2024-02-22T19:17:04.983 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:17:04 smithi063 bash[44872]: t=2024-02-22T19:17:04+0000 lvl=info msg="Stopped provisioningServiceImpl" logger=server reason="context canceled" 2024-02-22T19:17:04.983 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:17:04 smithi063 bash[44872]: t=2024-02-22T19:17:04+0000 lvl=info msg="Stopped RemoteCache" logger=server reason="context canceled" 2024-02-22T19:17:04.983 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:17:04 smithi063 bash[44872]: t=2024-02-22T19:17:04+0000 lvl=info msg="Stopped UsageStatsService" logger=server reason="context canceled" 2024-02-22T19:17:04.983 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:17:04 smithi063 bash[44872]: t=2024-02-22T19:17:04+0000 lvl=info msg="Stopped BackendPluginManager" logger=server reason="context canceled" 2024-02-22T19:17:04.983 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:17:04 smithi063 bash[44872]: t=2024-02-22T19:17:04+0000 lvl=info msg="Stopped AlertEngine" logger=server reason="context canceled" 2024-02-22T19:17:04.983 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:17:04 smithi063 bash[44872]: t=2024-02-22T19:17:04+0000 lvl=eror msg="Server shutdown" logger=server reason=nil 2024-02-22T19:17:05.539 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:17:05 smithi063 bash[57191]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715-grafana.a 2024-02-22T19:17:05.540 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:17:05 smithi063 bash[57228]: bash: /var/lib/ceph/e2bc0d14-d1b4-11ee-95bf-87774f69a715/grafana.a/unit.stop: No such file or directory 2024-02-22T19:17:05.963 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:17:05 smithi063 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@grafana.a.service: Main process exited, code=exited, status=1/FAILURE 2024-02-22T19:17:05.963 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:17:05 smithi063 systemd[1]: ceph-e2bc0d14-d1b4-11ee-95bf-87774f69a715@grafana.a.service: Failed with result 'exit-code'. 2024-02-22T19:17:05.963 INFO:journalctl@ceph.grafana.a.smithi063.stdout:Feb 22 19:17:05 smithi063 systemd[1]: Stopped Ceph grafana.a for e2bc0d14-d1b4-11ee-95bf-87774f69a715. 2024-02-22T19:17:16.720 INFO:tasks.cephadm:Removing cephadm ... 2024-02-22T19:17:16.720 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-22T19:17:16.744 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-22T19:17:16.763 INFO:tasks.cephadm:Teardown complete 2024-02-22T19:17:16.763 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-22T19:17:16.772 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-22T19:17:16.772 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-22T19:17:16.787 DEBUG:teuthology.orchestra.run.smithi063:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-22T19:17:16.805 INFO:teuthology.orchestra.run.smithi062.stderr:bash: ntpq: command not found 2024-02-22T19:17:16.809 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-22T19:17:16.809 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-02-22T19:17:16.810 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 4 +36us[ +36us] +/- 89ms 2024-02-22T19:17:16.810 INFO:teuthology.orchestra.run.smithi062.stdout:^* hv02.front.sepia.ceph.com 3 6 377 65 -403us[ -413us] +/- 72ms 2024-02-22T19:17:16.810 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 0 +383us[ +383us] +/- 74ms 2024-02-22T19:17:16.810 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-22T19:17:16.820 INFO:teuthology.orchestra.run.smithi063.stderr:bash: ntpq: command not found 2024-02-22T19:17:16.824 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-22T19:17:16.825 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2024-02-22T19:17:16.825 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 3 +55us[ +50us] +/- 89ms 2024-02-22T19:17:16.825 INFO:teuthology.orchestra.run.smithi063.stdout:^* hv02.front.sepia.ceph.com 3 6 377 2 -389us[ -394us] +/- 73ms 2024-02-22T19:17:16.825 INFO:teuthology.orchestra.run.smithi063.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 +417us[ +412us] +/- 74ms 2024-02-22T19:17:16.825 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-02-22T19:17:16.825 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-22T19:17:16.833 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-22T19:17:16.835 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-22T19:17:16.843 DEBUG:teuthology.orchestra.run.smithi062:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-22T19:17:16.922 DEBUG:teuthology.orchestra.run.smithi063:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-22T19:17:16.985 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-22T19:17:17.017 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-22T19:17:17.017 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-22T19:17:17.046 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-22T19:17:17.047 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-22T19:17:17.057 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-22T19:17:17.093 INFO:teuthology.task.internal:Duration was 2101.837848 seconds 2024-02-22T19:17:17.094 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-22T19:17:17.102 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-22T19:17:17.102 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-22T19:17:17.104 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-22T19:17:17.151 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-22T19:17:17.151 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-22T19:17:17.494 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-22T19:17:17.494 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2024-02-22T19:17:17.494 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-22T19:17:17.519 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi063.front.sepia.ceph.com 2024-02-22T19:17:17.519 DEBUG:teuthology.orchestra.run.smithi063:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-22T19:17:17.542 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-22T19:17:17.543 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-22T19:17:17.562 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-22T19:17:17.646 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-22T19:17:17.646 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-22T19:17:17.648 DEBUG:teuthology.orchestra.run.smithi063:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-22T19:17:17.803 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-22T19:17:17.813 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-22T19:17:17.813 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-22T19:17:17.841 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-22T19:17:17.869 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-22T19:17:17.878 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-22T19:17:17.883 DEBUG:teuthology.orchestra.run.smithi063:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-22T19:17:17.908 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2024-02-22T19:17:17.937 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = core 2024-02-22T19:17:17.967 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-22T19:17:17.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-22T19:17:17.987 DEBUG:teuthology.orchestra.run.smithi063:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-22T19:17:18.024 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-22T19:17:18.025 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-22T19:17:18.034 INFO:teuthology.task.internal:Transferring archived files... 2024-02-22T19:17:18.035 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570945/remote/smithi062 2024-02-22T19:17:18.035 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-22T19:17:18.082 DEBUG:teuthology.misc:Transferring archived files from smithi063:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570945/remote/smithi063 2024-02-22T19:17:18.083 DEBUG:teuthology.orchestra.run.smithi063:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-22T19:17:18.125 INFO:teuthology.task.internal:Removing archive directory... 2024-02-22T19:17:18.125 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-22T19:17:18.127 DEBUG:teuthology.orchestra.run.smithi063:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-22T19:17:18.176 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-22T19:17:18.187 INFO:teuthology.task.internal:Not uploading archives. 2024-02-22T19:17:18.187 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-22T19:17:18.236 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-22T19:17:18.236 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-22T19:17:18.238 DEBUG:teuthology.orchestra.run.smithi063:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-22T19:17:18.254 INFO:teuthology.orchestra.run.smithi062.stdout: 525356 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 22 19:17 /home/ubuntu/cephtest 2024-02-22T19:17:18.256 INFO:teuthology.orchestra.run.smithi063.stdout: 526077 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 22 19:17 /home/ubuntu/cephtest 2024-02-22T19:17:18.257 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-22T19:17:18.285 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-22T19:17:18.364 INFO:teuthology.nuke:Checking targets against current locks 2024-02-22T19:17:18.392 DEBUG:teuthology.nuke:shortname: smithi062 2024-02-22T19:17:18.392 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-22T19:17:18.416 DEBUG:teuthology.nuke:shortname: smithi063 2024-02-22T19:17:18.417 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-22T19:17:18.420 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570945', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-22 18:18:36.622321', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCoOCOxDlBOpsoSnCF8ASrPagfD8NY+HTjPizceoX+hd7er91STGzQcK7JxsXoVJax4pMgXRsRy4d1VeH7grdYE='} 2024-02-22T19:17:18.442 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-22_18:15:46-rados-pacific-release-distro-default-smithi/7570945', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-22 18:18:36.620572', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH+eFwCrLJzFpx0tgYtF+cjHtaiNPa9ApyQKEPSnQf2sc675rM+kPsG68TZrB7luewfHGMoprUztRRbZ0EJheiI='} 2024-02-22T19:17:18.467 INFO:teuthology.orchestra.console.smithi062:Power off 2024-02-22T19:17:18.467 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-22T19:17:18.483 INFO:teuthology.orchestra.console.smithi063:Power off 2024-02-22T19:17:18.483 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-22T19:17:18.493 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2024-02-22T19:17:18.493 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T19:17:18.506 DEBUG:teuthology.orchestra.console.smithi063:power off output: Chassis Power Control: Down/Off 2024-02-22T19:17:18.506 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T19:17:18.516 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2024-02-22T19:17:18.529 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on 2024-02-22T19:17:22.518 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T19:17:22.530 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T19:17:22.629 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2024-02-22T19:17:22.639 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is on 2024-02-22T19:17:26.632 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T19:17:26.640 DEBUG:teuthology.orchestra.console.smithi063:pexpect command: ipmitool -H smithi063.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-22T19:17:26.741 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2024-02-22T19:17:26.749 DEBUG:teuthology.orchestra.console.smithi063:check power output: Chassis Power is off 2024-02-22T19:17:26.843 INFO:teuthology.orchestra.console.smithi062:Power off completed 2024-02-22T19:17:26.850 INFO:teuthology.orchestra.console.smithi063:Power off completed 2024-02-22T19:17:26.955 INFO:teuthology.run:Summary data: description: rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} duration: 2101.8378477096558 failure_reason: 'Command failed on smithi062 with status 1: ''sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2bc0d14-d1b4-11ee-95bf-87774f69a715 -e sha1=eb66ed921e744301e6863be6353618d63967ea59 -- bash -c \''ceph versions | jq -e \''"\''"\''.overall | length == 1\''"\''"\''\''''' owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=741c886549ef411c928e8e23896d9112 status: fail success: false 2024-02-22T19:17:26.956 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-22T19:17:27.034 INFO:teuthology.run:FAIL